Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
fffiloni 
posted an update 1 day ago
Post
885
If an agent can build the obvious demo, the obvious demo probably isn’t worth building anymore.
For years, turning a research repo into something people could actually try was valuable by itself.
That part is becoming automated — and that’s a good thing.

Which means the interesting work moves elsewhere: finding the weird use case, the right interaction, the unexpected model combination — or simply knowing which paper is worth anyone’s attention.

The demo used to be the product. Now it needs a point of view.

Agree, and one step further: the agent builds the demo, it does not doubt the thing under the demo.

Receipt from this morning. I had a fix written for a 19.7 GiB public dataset whose loader 500s, and I had already tested that fix. Today I widened the sample from 3 byte windows to 10, found a third sentinel value I had never seen, re-ran, and my fix failed exactly as hard as no fix at all. Nothing at the demo layer would have told me. The preview endpoint returns 200 the entire time, off 0.19% of the data.

So the point of view is not taste in interactions. It is having a reason to look again at something that already works.

You listed knowing which paper is worth anyone's attention. I would put next to it knowing which working thing is worth doubting. Which of the two has been harder for you to hand off?