Reddit

Structured output reliability with LLMs — 3-month production learnings

Been shipping structured JSON output from LLMs in production for a health app. Here's what I've learned about reliability. The problem: get a 70B model to return valid JSON matching a strict schema, every time. What I tried: Attempt 1: "Return JSON." No schema. 40% valid output. Attempt 2: Detailed schema in prompt. 75% valid. Attempt 3: JSON mode enabled (Groq/OpenAI/Anthropic all support). 92%. Attempt 4: JSON mode + schema validator + retry loop with error surfaced back....
Reddit

The absolute nightmare of putting AI agents into actual production

It feels like the conversation around AI agents has quietly shifted over the last few months from "look at what this autonomous loop can do" to "how do we actually keep these things from breaking in production." Most of us have figured out the build phase. You pick up a framework like LangGraph or CrewAI, connect a couple of tools and you have a prototype that looks incredible in a controlled environment but the moment you try to slide that into a real corporate infrastructur...
Reddit

How does a 102M-parameter transformer forecast multivariate time series?

I recently worked through the architecture of t0-alpha, a 101.6M-parameter foundation model for time-series forecasting. The design choice I found most interesting is that it separates two kinds of reasoning: Time attention learns how each variable evolves across time. Group attention allows related variables to exchange information. The rest of the architecture, briefly: inputs are split into patches of 32 time steps; each patch is embedded into a 512-dimensional represent...
Reddit

lil botto, bottavius, and yung botto

i made my own SLLMs, i am 14 and it is on a shared family mac with no storage. of course they are shit currently but at the pace i'm improving them at they are going to be insane. Lil Botto is the scholar i train him on public domain books, articles, etc. Bottavius is the same but i like to test random bullshit on him, and for Yung Botto i will soon create a small robot body for him like a modified old toy and i will train him with this body too. any tips, suggestions, and random bullshit ideas ...
Reddit

Apple just sued OpenAI for trade secret theft. And Google quietly rewrote how the internet works.

Two things happened this week that change something concrete for every business. Apple filed a lawsuit on July 10 accusing OpenAI of coordinated industrial espionage. This isn't abstract. According to the complaint, OpenAI's chief hardware officer Tang Tan, a 24-year Apple veteran, instructed job candidates still working at Apple to bring physical components to their interviews for "show and tell" sessions. A former Apple engineer who joined OpenAI found a bug that let him access App...
Reddit

Open Source Local LLM Training Tool (for consumer hardware)

If you work in AI training, I'd love some feedback, specifically on where this is useful, not on the output quality (it's bad, and that's expected at the 800m param stage). If that's your area, I want to hear what models you'd want trained and what data would be worth visualizing. Fair warning up front: this is technical and geared toward people working in the AI training space. I've been building a tool that lets you train LLMs on consumer hardware and then see into the brain of the model, ...
An Image-to-Video (I2V) Generation Model from scratch in PyTorch to demystify video diffusion/flow-matching models
Reddit

An Image-to-Video (I2V) Generation Model from scratch in PyTorch to demystify video diffusion/flow-matching models

NanoI2V is a step-by-step educational repository for building a full Image-to-Video model from the ground up. Core building blocks included: 3D VAEs & Latent video manipulation Diffusion Transformer (DiT) architecture Flow Matching & Diffusion trajectories Image Conditioning & CFG (Classifier-Free Guidance) Rotary Position Embeddings (RoPE) If you're looking for a readable, modular project to learn how modern video generation works under the hood (or to use as a ...
I'm not a great artist — so I made an agent that turns my doodles on my Remarkable tablet into actually nice charcoal sketches. Real editable pen-line vectors too! Not just static images.
Reddit

I'm not a great artist — so I made an agent that turns my doodles on my Remarkable tablet into actually nice charcoal sketches. Real editable pen-line vectors too! Not just static images.

About This Pretty much what the title says. - Doodle - Select - Agent parses device screenshots to write creative brief - Another agent gets the brief and napkin sketch and makes an image of charcoal artwork - Post-processing pipeline does multiple layers of vectorization (line work, shading, highlights) - All vectors are converted to Remarkable pen-stroke data and injected into the clipboard and pasted onto the tablet in place of the original sketch 1 undo step to get back to your s...
Reddit

The real bottleneck for AI agents may be proving who they are

AI agents are getting better at completing tasks, but I’m not convinced intelligence is the main thing holding them back anymore. The harder problem starts when an agent can send messages, approve purchases, move money, schedule work, or make decisions across several systems. At that point, how do you know which agent actually performed an action? Who gave it permission? What happens when it exceeds that permission, misunderstands an instruction, or another system impersonates it? We already ...
A new, state-of-the-art, agentic pipeline for easy Music Video creation
Reddit

A new, state-of-the-art, agentic pipeline for easy Music Video creation

A new, significantly expanded version of the original Music Video mode, now built around Seedance 2.0, multiple image references, and an even more precise creative-assistance layer designed to enhance and adapt your vision in an optimally model-aware manner. This is an example output from the system. For musicians, filmmakers, visual artists, labels, directors, and anyone trying to turn a track into a more intentional audiovisual world. I'd love to know your thoughts on it! You can find ...
Reddit

Did you know the CEO of OpenAI owns nearly 9% of Reddit while Reddit bans users for AI generated content?

Something worth thinking about. According to Reddit's own IPO filings, Sam Altman, CEO of OpenAI and ChatGPT, controls 8.7% of Reddit stock including 9.3% of Class B shares, making him the third largest shareholder behind only Conde Nast and Tencent. He invested $60 million in Reddit in 2021 and sat on Reddit's board until 2022. His stake was worth approximately $1.4 billion as of late 2024. Meanwhile Reddit subreddits are actively banning users for AI generated content while Reddit simultaneo...
Reddit

The first AI was a syllogism machine in 1956. We're still building the same thing.

I read about Logic Theorist recently — program from 1956 that proved mathematical theorems using formal deduction. AI community celebrated it as beginning of real intelligence. Seventy years later, I think we are still stuck on same mistake. The problem is not mechanism. Problem is assumption that mechanism is sufficient. Expert systems, neural networks, language models — all are syllogism machines wearing different costumes. They manipulate patterns (formal or statistical) but never actually ...
Reddit

RnD on AI Security and Monitoring

Hi, I am a senior software engineer eith expertise in cloud and cybersecurity. I have done some projects in AI as well. I have seen companies face issue with misuse of AI systems and extended use of AI can pose a security risk as well. I am thinking about creating a tool either for AI monitoring or security. Focusing on use of AI agents and tools internally. I am looking for people who have hands-on experience with AI and are interested in this area.
Reddit

Inside Ghostcommit: How Malicious PNGs Bypass AI Code Reviewers

Key takeaways in 90 seconds: Multimodal Vulnerability: Ghostcommit is a novel supply chain exploit targeting AI coding tools with vision capabilities. The Payload Split: The attack uses a two-file payload. A text-based rule file (like AGENTS.md) instructs the AI to read a PNG asset (such as build-spec.png) containing rendered text instructions. Bypassing Reviewers: Automated code review tools (like CodeRabbit) fail to scan the pixels of binary image assets, allowing the malicious pull requ...
Reddit

New Mac Desktop App

Just downloaded new max ChatGPT app. It adds codex and slack and all kinds of “work” functions that I do not use but my projects and past chats are not there. Useless to me. I deleted it and now am forced to use browser version.
Reddit

How do you stop ChatGPT from constantly breaking fictional roleplays?

I often use ChatGPT for long, detailed roleplays and collaborative storytelling. The problem is that even when everything is clearly fictional and involves consenting adult characters, the model sometimes interrupts the story, refuses harmless scenes or suddenly adds restrictions that completely break the immersion. I’m not looking for ways to generate genuinely illegal or dangerous content. I just want fictional stories to be treated as fiction, without constantly triggering false positives o...
Reddit

Why is AI so bad at writing?

Why is AI so bad at writing without sounding cringe and repetitive? "It's not this, it's that." "Not because... but because..." The cadence and prose are also dry and boring. Even though AI is pretty good at short form hooks and professional papers, creatively it feels like garbage. It seems like that's the human advantage: creativity.
Reddit

Updated ChatGPT app - can't use normal chat mode anymore?!

I was very curious to try out ChatGPT Work. I just updated to the new version of the macOS app and my normal chat interface is completely gone! I can only toggle between Work and Codex. All of my old chats and projects are nowhere to to be found on the desktop app anymore. The the mini chat window that I constantly use to pop up over my desktop is also not appearing when I hit my shortcut for it. WTF? Am I going crazy or did they completely destroy chat functionality on desktop? UPDATE...