Doing the Lord’s work in the Devil’s basement

  • 0 Posts
  • 176 Comments
Joined 6 months ago
cake
Cake day: May 8th, 2024

help-circle




  • Honestly the use case i’m working on is pretty mind blowing. User records an unstructured voice note like “i am out of item 12, also prices of items 13 & 15 is down to 4 dollars 99, also shipping for all items above 1kg is now 3 dollars 99” and the LLM will search the database for items >1kg (using tool calling) then generate a JSON representing the changes to be made. We use that JSON to make a simple UI where the user can review the changes - then voilà it’s sent to the backend which persists the change in database. In the ideal case the user never even pulls up the virtual keyboard on their phone, it’s just “talk, check, click, done”.



  • I’m currently a guy working on something like this ! It’s even simpler as you can have structured output on the chatgpt API. Basically you give it a JSON schema and it’s guaranteed to respond with JSON that validates against that schema. Spent a couple weeks hacking at it and i’m positively impressed, I have had clean JSON 100% of the time, and the data extraction is pretty reliable too.

    The tooling is actually reaching a sweet spot right now where it makes sense to integrate LLMs in production code (if the use case makes sense and you haven’t just shoe-horned it in for the hype).


  • I suspect a lot comes from the ingredients being mediocre when you buy them at high demand periods.

    I come from the French country side, my father raises poultry and makes his own foie gras and deli meats. When I see the shit they sell at Christmas, which most of my fellow countrymen eat every year… I wouldn’t be surprised reading a comment similar to yours about French Christmas food.

    Maybe your grandma can’t afford the good stuff, or doesn’t have access to it ?




  • At least acc. to TechSpot, the negative sentiment is general. It’s just more pronounced for some products (high risk and/or price) than others.

    That’s not what the study says. I’m no AI-hater but I would sure stay away from an AI car or medical diagnosis. Those products make absolutely no sense.

    So even where plopping a LLM or similar would make sense, there’ll be likely strong market resistance.

    I work tangentially to the industry (not making models, not making apps based on models, but making tools to help people who do) and that is not what i observed. Just like in every market, products that make sense make fucking bank. It’s mostly boring B2B stuff which doesn’t make headlines but there is some money being made right now, with some very satisfied customers.

    The “market resistance” story is anecdotal clickbait.