O1 doesn’t seem to need any particularly specific prompts. It seems to work just fine on just about anything I give it. It’s still not fantastic, but often times it comes up with things I either would have had to spend a lot of time to get right or just plainly things I didn’t know about myself.

I don’t ask LLMs about anything going on in my personal or business life. It’s purely a technical means to an end for me. So that’s where the disconnect is maybe.

For what I’m doing OpenAI’s models consistently rank last. I’m even using Flash 2 over 4o mini.

Not sure what you mean, but are you saying you don't ask it anything related to work at all?

I'm curious what you are asking it to do and whether you think the thoughts it expresses along the seemed likely to lead it in a useful direction before it resorted to a summary. Also perhaps it doesn't realize you don't want a summary?

People be like, "please provide me with a full stack web app" and then think its bad when it doesnt.