Testing Inflation with Large Scale Structure: Connecting Hopes with Reality