Most important piece of information is in the linked Frontiers article:
However, the overall capability of the chatbot to fully meet user needs received a lower average score (3.1/5.0), highlighting the need for further improvements.
Also there is still the problem of hallucinations, as we see in the „Evaluation“ paragraph:
Live traffic evaluations are essential for monitoring system behavior, identifying potential issues like hallucinations in production, and understanding performance on diverse live queries.
This are quite devastating results. This is a system for scientific research on medicines and mediocrity and hallucinations will kill people.
Would be interesting to know how much money was flushed down the toilet with these experts.
The 3.1/5.0 score in the Frontiers paper is a user satisfaction rating on feature completeness. Researchers were asked how well the system met all of their needs, including features that simply didn't exist yet at that point. It's a product maturity signal, not an accuracy or reliability number. The paper is also about a year old and the system has moved on significantly since.
On hallucinations, I'd push back on the framing a bit. The fact that we monitor for hallucinations isn't an admission that the system is hallucinating undetected. It's the opposite. Every sentence in the response is linked back to the exact page and verbatim quote from the source document, so a researcher can verify any claim in one click. We also run faithfulness scoring on live traffic every single day using RAGAS, so if the system starts drifting we catch it fast, not at some quarterly review.
And for the regulatory document drafting use case, every output is explicitly reviewed and approved by a qualified scientist before it goes anywhere. The system drafts, the human decides. That's not incidental; it's a design constraint baked into the architecture.
No LLM eliminates hallucination entirely. That's just the reality of the technology right now. So the engineering question becomes: how do you make it as unlikely as possible, and when it does happen, how fast do you catch it? That's what the retrieval pipeline, the reflection agent, the citations, and the daily evals are all doing. It's not a perfect answer, but it's a serious one.
The most important part is the database that the agent can see and how clean the data is. I pitched a custom enterprise agent to a client thinking it would be maybe 50/50 time on data vs agent tuning, but it's more like 99/1.
The alignment process goes very quickly once you have all the fish in exactly one barrel. I think pulling data dynamically from the source systems is where this turns into a game of whack-a-mole.
The problem with dynamic fetch is that you don't get any kind of persistent or compounding gains. There are queries that you simply cannot run because you'd chew through your GitHub, et. al., API quotas. It takes over 48h to fully hydrate the database for GitHub items on my current project. But, once that process is complete I can query across things like issue comments and do crosscutting joins with the state of other vendor systems in milliseconds.
I am finding the MSSQL dialect to be quite agreeable to the OAI models. With absolutely no prompting they will bootstrap off information schema and extended description properties every single time. If you design the schema for your audience, the amount of "Jesus prompting" you will require is much better controlled.
The problem with this is that you have a consistency problem if you want to take action. The only way of making your agents read-write rather than read-only in practice is to use the underlying systems rather than try and pool information in a data lake.
But that does make it more complex to build simple information retrieval use cases.
You definitely need multiple paths. It's not one vs the other. The data warehouse is immutable to the agent. There are separate tools that handle any updates to business state.
I have a question: How does connecting agent to db directly work in case of multi tenant system? There is a high chance that agent can snoop into multiple tenants and mess up the responses
I think this mostly depends on your business model.
In my client's business, the idea of having all their customer knowledge contained in one global scope is a fantasy, not a fear.
I suppose if you were granting access to users outside the business that this could become a concern, but I haven't encountered anyone who is interested in that yet.
That's funny because I have worked with hundreds and hundreds of TSQL products and only those built mostly in the last century have extended attributes (documenting each object in the database itself) - its nice but clunky and few things support it.
Seeing this article and seeing the replies. Oof. Maybe Thoughtworks did some good work in traditional software engineering (not sure) - but why would you trust them to touch anything related to LLMs. They don't seem to know what they are doing.
You can almost tell the "era" that a solution was built in these days since things are changing so fast.
Mid-2026, we have very large context windows, and much smarter models than we did in 2024 when this was built. If I were to tackle this today I'd ask a current frontier model to work through the source data and design a hierarchy that would give it the ability to sift through the content itself by drilling down as it sees fit, and I expect it would nail that.
I have gone through this process and evaluated the results. Maybe you're referring to their comment as written, but going through what OC described + handholding leads to very good results in my experience.
Yeah that's what we're realising in building pharma specific solutions for clients, high quality eval dataset and automated evals integrated in the CI/CD process seem to be the differentiators
What was the main driver for a dynamic workflow with loops vs a rigid forward running only workflow. The non-deterministic nature of these loops with LLM decision points doesn't mesh well with the transparency requirement imho
I happen to have made another attempt trusting an agentic tool, latest "Continue" with frontier model: 8M token burned in 30 minutes. App does not work.
I find papers/articles which discuss solutions that rely heavily on a model in the middle unreadable, if the models used are not discussed.
The data you need to get into context for a small model, vs a big boy frontier model, vs a fine tuned open weight big boy- are all very different. I can understand what they're doing here, and most of the 'why', but- not all of the why.
I think for mostly search-focused use case like the one presented here AI is great as you don't ask it to build stuff or invent new drugs, you just want to retrieve relevant documents with laser precision, and agents can do that.
I think right now I'm mostly disappointed with agents writing code as they always degrade the quality of the codebase after a while, and the same goes for writing in general which just requires a ton of editing and mostly just sounds good but doesn't have a lot of substance in the end. I think you can really tell that these systems are trained to just produce plausible streams of text, especially in longer artefacts you notice that locally the inner consistency of what they produce is great but globally it really falls apart, it's like seeing the limits of their "intelligence".
For search however I really like AI, it has improved information retrieval so much for me where before I had to think about which keywords to use and combine and which filters to apply, describing what I'm looking for in plain text and then having the AI find it for me feels magical. Recently I wanted to find an artist that I heard in some old episode of the KEXP runcast (a running podcast), and I didn't remember anything except that it was rap with a kind of monotone voice a fast beat and a strong accent. Googles' agent asked a few clarifying questions and after a few rounds it found the artist for me, Genesis Uwusu. That's why I think Google will win in the AI assisted search market, they just have the best integration between fast and reasonably "smart" agents and high quality search data. Claude or ChatGPT are too slow and don't have fast enough data retrieval it seems, using them for search feels quite sluggish in comparison.
> you just want to retrieve relevant documents with laser precision
My experience with using LLMs for search is that they do _not_ have laser precision. Far from it in fact. If you want to retrieve documents with laser precision AI is the wrong tool. If you want a fuzzy, lossy synthesised query response based on those documents, LLMs are great.
> The author used AI assistance during the writing of this article. AI tools were used for brainstorming ideas, creating outlines, and reviewing drafts to polish language and improve clarity.
The first sentence makes it seem like they just used to improve sentence structure etc but the second line makes it seem like they used it for 90% of the work. Which one is true?
The funniest part of these systems is that I build these massive prompt concatenating controllers with a schema to constrain what the LLM sees and parses, usually a frontier model like Gemini
The model gets it wrong on occasion and I check the input file with Claude/Opus and it just laughs at how simple it is to get the document right
And in the back of my mind I’m thinking why am I not just sending the file through Opus
These vast multi-agentic systems with roles like 'Researcher', 'Writer' (with a review loop), 'Reflection agent', seem to ~feel~ mostly right but lack evals as to the merit of agent decomposition. So it forms a satisfying enough flowchart but I see no evidence these authors actually tried other approaches or agent roles. And let's be honest: an agent is just a system prompt and output contracts, and these rich architectures seem to be pontificating beyond their worth. It all feels a bit vibe-y.
I've been wondering lately if old-school cybernetics might help there.
But my off-the-cuff, uninformed opinion is that the precise structure doesn't matter too much, and the impact these structures really have is that they allow More Tokens for the Token Furnace.
Bad architects favour microservices over monoliths.
YAGNI almost always applies to microservices, and the coordination overhead and boilerplate they add introduces immense costs, especially for smaller companies.
This homogenisation of architecture around Netflix size engineering has really cost our industry a lot.
Most important piece of information is in the linked Frontiers article:
Also there is still the problem of hallucinations, as we see in the „Evaluation“ paragraph: This are quite devastating results. This is a system for scientific research on medicines and mediocrity and hallucinations will kill people.Would be interesting to know how much money was flushed down the toilet with these experts.
Author here. A couple of things worth clarifying.
The 3.1/5.0 score in the Frontiers paper is a user satisfaction rating on feature completeness. Researchers were asked how well the system met all of their needs, including features that simply didn't exist yet at that point. It's a product maturity signal, not an accuracy or reliability number. The paper is also about a year old and the system has moved on significantly since.
On hallucinations, I'd push back on the framing a bit. The fact that we monitor for hallucinations isn't an admission that the system is hallucinating undetected. It's the opposite. Every sentence in the response is linked back to the exact page and verbatim quote from the source document, so a researcher can verify any claim in one click. We also run faithfulness scoring on live traffic every single day using RAGAS, so if the system starts drifting we catch it fast, not at some quarterly review.
And for the regulatory document drafting use case, every output is explicitly reviewed and approved by a qualified scientist before it goes anywhere. The system drafts, the human decides. That's not incidental; it's a design constraint baked into the architecture.
No LLM eliminates hallucination entirely. That's just the reality of the technology right now. So the engineering question becomes: how do you make it as unlikely as possible, and when it does happen, how fast do you catch it? That's what the retrieval pipeline, the reflection agent, the citations, and the daily evals are all doing. It's not a perfect answer, but it's a serious one.
The most important part is the database that the agent can see and how clean the data is. I pitched a custom enterprise agent to a client thinking it would be maybe 50/50 time on data vs agent tuning, but it's more like 99/1.
The alignment process goes very quickly once you have all the fish in exactly one barrel. I think pulling data dynamically from the source systems is where this turns into a game of whack-a-mole.
The problem with dynamic fetch is that you don't get any kind of persistent or compounding gains. There are queries that you simply cannot run because you'd chew through your GitHub, et. al., API quotas. It takes over 48h to fully hydrate the database for GitHub items on my current project. But, once that process is complete I can query across things like issue comments and do crosscutting joins with the state of other vendor systems in milliseconds.
I am finding the MSSQL dialect to be quite agreeable to the OAI models. With absolutely no prompting they will bootstrap off information schema and extended description properties every single time. If you design the schema for your audience, the amount of "Jesus prompting" you will require is much better controlled.
The problem with this is that you have a consistency problem if you want to take action. The only way of making your agents read-write rather than read-only in practice is to use the underlying systems rather than try and pool information in a data lake.
But that does make it more complex to build simple information retrieval use cases.
You definitely need multiple paths. It's not one vs the other. The data warehouse is immutable to the agent. There are separate tools that handle any updates to business state.
I’m trying to solve this problem and would love to get some feedback: https://entidade.wls-labs.com
I have a question: How does connecting agent to db directly work in case of multi tenant system? There is a high chance that agent can snoop into multiple tenants and mess up the responses
I think this mostly depends on your business model.
In my client's business, the idea of having all their customer knowledge contained in one global scope is a fantasy, not a fear.
I suppose if you were granting access to users outside the business that this could become a concern, but I haven't encountered anyone who is interested in that yet.
With postgres you can use schemas to keep tenants separate and use RLS on shared data.
That's funny because I have worked with hundreds and hundreds of TSQL products and only those built mostly in the last century have extended attributes (documenting each object in the database itself) - its nice but clunky and few things support it.
Seeing this article and seeing the replies. Oof. Maybe Thoughtworks did some good work in traditional software engineering (not sure) - but why would you trust them to touch anything related to LLMs. They don't seem to know what they are doing.
You can almost tell the "era" that a solution was built in these days since things are changing so fast.
Mid-2026, we have very large context windows, and much smarter models than we did in 2024 when this was built. If I were to tackle this today I'd ask a current frontier model to work through the source data and design a hierarchy that would give it the ability to sift through the content itself by drilling down as it sees fit, and I expect it would nail that.
It would not, and you would know that if you actually evaluated the results.
I have gone through this process and evaluated the results. Maybe you're referring to their comment as written, but going through what OC described + handholding leads to very good results in my experience.
I agree with you agentdev! Here, you want accurate results, you need to have harness in place to control the quality of output.
i can almost tell then you have not done anything like this in production scale. context window size is irrelevant.
Two paragraph section on Evaluation after 30 paragraphs explaining the most bog standard rag system you've ever heard of.
Hmm...
Yeah that's what we're realising in building pharma specific solutions for clients, high quality eval dataset and automated evals integrated in the CI/CD process seem to be the differentiators
What was the main driver for a dynamic workflow with loops vs a rigid forward running only workflow. The non-deterministic nature of these loops with LLM decision points doesn't mesh well with the transparency requirement imho
I happen to have made another attempt trusting an agentic tool, latest "Continue" with frontier model: 8M token burned in 30 minutes. App does not work.
I find papers/articles which discuss solutions that rely heavily on a model in the middle unreadable, if the models used are not discussed.
The data you need to get into context for a small model, vs a big boy frontier model, vs a fine tuned open weight big boy- are all very different. I can understand what they're doing here, and most of the 'why', but- not all of the why.
I think for mostly search-focused use case like the one presented here AI is great as you don't ask it to build stuff or invent new drugs, you just want to retrieve relevant documents with laser precision, and agents can do that.
I think right now I'm mostly disappointed with agents writing code as they always degrade the quality of the codebase after a while, and the same goes for writing in general which just requires a ton of editing and mostly just sounds good but doesn't have a lot of substance in the end. I think you can really tell that these systems are trained to just produce plausible streams of text, especially in longer artefacts you notice that locally the inner consistency of what they produce is great but globally it really falls apart, it's like seeing the limits of their "intelligence".
For search however I really like AI, it has improved information retrieval so much for me where before I had to think about which keywords to use and combine and which filters to apply, describing what I'm looking for in plain text and then having the AI find it for me feels magical. Recently I wanted to find an artist that I heard in some old episode of the KEXP runcast (a running podcast), and I didn't remember anything except that it was rap with a kind of monotone voice a fast beat and a strong accent. Googles' agent asked a few clarifying questions and after a few rounds it found the artist for me, Genesis Uwusu. That's why I think Google will win in the AI assisted search market, they just have the best integration between fast and reasonably "smart" agents and high quality search data. Claude or ChatGPT are too slow and don't have fast enough data retrieval it seems, using them for search feels quite sluggish in comparison.
> you just want to retrieve relevant documents with laser precision
My experience with using LLMs for search is that they do _not_ have laser precision. Far from it in fact. If you want to retrieve documents with laser precision AI is the wrong tool. If you want a fuzzy, lossy synthesised query response based on those documents, LLMs are great.
The part about context discipline feels underrated. Larger context windows don’t remove the need to decide what the model shouldn’t see.
Totally!
> The author used AI assistance during the writing of this article. AI tools were used for brainstorming ideas, creating outlines, and reviewing drafts to polish language and improve clarity.
The first sentence makes it seem like they just used to improve sentence structure etc but the second line makes it seem like they used it for 90% of the work. Which one is true?
Your question answered it I think. The first sentence aims to mislead. The second sentence covers their ass.
I'd love to see the number of man hours that led to that sentence, and how proud they were to have come up with it.
> Sarang Kulkarni is a Principal Consultant at Thoughtworks
> teaches an O’Reilly course on building production-ready RAG applications
isn't this basically saying that you are a scammer? or am I paranoid?
The funniest part of these systems is that I build these massive prompt concatenating controllers with a schema to constrain what the LLM sees and parses, usually a frontier model like Gemini
The model gets it wrong on occasion and I check the input file with Claude/Opus and it just laughs at how simple it is to get the document right
And in the back of my mind I’m thinking why am I not just sending the file through Opus
These vast multi-agentic systems with roles like 'Researcher', 'Writer' (with a review loop), 'Reflection agent', seem to ~feel~ mostly right but lack evals as to the merit of agent decomposition. So it forms a satisfying enough flowchart but I see no evidence these authors actually tried other approaches or agent roles. And let's be honest: an agent is just a system prompt and output contracts, and these rich architectures seem to be pontificating beyond their worth. It all feels a bit vibe-y.
I've been wondering lately if old-school cybernetics might help there.
But my off-the-cuff, uninformed opinion is that the precise structure doesn't matter too much, and the impact these structures really have is that they allow More Tokens for the Token Furnace.
What would the benefit be? A mega agent that does everything?
There are some well documented advantages of decomposition...that's why the industry favours microservices over monoloths.
Bad architects favour microservices over monoliths.
YAGNI almost always applies to microservices, and the coordination overhead and boilerplate they add introduces immense costs, especially for smaller companies.
This homogenisation of architecture around Netflix size engineering has really cost our industry a lot.
You cannot
Absolutely. Either you use LLMs and tolerate unreliability or you are writing proper reliable software yourself
Why is comment from padolsey dead? Seriously, something fishy is going on on this website.