I came across this company called OpenEvidence. They seem to be offering semantic search on medical research. Founded in 2021.
How could it possibly keep up with LLM based search?
dnw 3 hours ago [-]
It is a little more than semantic search. Their value prop is curation of trusted medical sources and network effects--selling directly to doctors.
I believe frontier labs have no option but to go into verticals (because models are getting commoditized and capability overhang is real and hard to overcome at scale), however, they can only go into so many verticals.
simianwords 3 hours ago [-]
> Their value prop is curation of trusted medical sources
Interesting. Why wouldn't an LLM based search provide the same thing? Just ask it to "use only trusted sources".
tacoooooooo 3 hours ago [-]
They're building a moat with data. They're building their own datasets of trusted sources, using their own teams of physicians and researchers. They've got hundreds of thousands of physicians asking millions of questions everyday. None of the labs have this sort of data coming in or this sort of focus on such a valuable niche
simianwords 3 hours ago [-]
> They're building their own datasets of trusted sources, using their own teams of physicians and researchers.
Oh so they are not just helping in search but also in curating data.
> They've got hundreds of thousands of physicians asking millions of questions everyday. None of the labs have this sort of data coming in or this sort of focus on such a valuable niche
I don't take this too seriously because lots of physicians use ChatGPT already.
some_random 2 hours ago [-]
Lots of physicians use ChatGPT but so do lots of non-physicians and I suspect there's some value in knowing which are which
dnw 46 minutes ago [-]
Yes, they can. We have gotten better at grounding LLMs to specific sources and providing accurate citations. Those go some distance in establishing trust.
There is trust and then there is accountability.
At the end of the day, a business/practice needs to hold someone/entity accountable. Until the day we can hold an LLM accountable we need businesses like OpenEvidence and Harvey. Not to say Anthropic/OpenAI/Google cannot do this but there is more to this business than grounding LLMs and finding relevant answers.
otikik 2 hours ago [-]
I don't think you can use an LLM for that. For the same reason you can't just ask it to "Make the app secure and fast"
simianwords 2 hours ago [-]
This is completely incorrect. This is exactly what LLMs can do better.
sjsjshzhhz 56 minutes ago [-]
Somebody should tell the Claude code team then. They’ve had some perf issues for awhile now.
More seriously, the concept of trust is extremely lossy. The LLM is gonna lean in one direction that may or may not be correct. At the extreme, it wound likely refute a new discovery that went against what we currently know. In a more realistic version, certain AIs are more pro Zionist than others.
simianwords 38 minutes ago [-]
I meant that LLMs can be trusted to do searches and not hallucinate while doing it. You’ve taken that to mean it can comply with anything.
The thing is, LLMs are quite good at search and probably way way more strong that whatever RAG setup this company has. What failure mode are you looking at from a search perspective? Will ChatGPT just end up providing random links?
palmotea 3 hours ago [-]
> Why wouldn't an LLM based search provide the same thing? Just ask it to "use only trusted sources".
Is that sarcasm?
simianwords 3 hours ago [-]
why?
Rygian 3 hours ago [-]
How does the LLM know which sources can be trusted?
simianwords 2 hours ago [-]
yeah it can avoid blogspam as sources and prioritise research from more prestigious journals or more citations. it will be smart enough to use some proxy.
palmotea 2 hours ago [-]
You can also tell it to just not hallucinate, right? Problem solved.
I think what you'll end up is a response that still relies on whatever random sources it likes, but it'll just attribute it to the "trusted sources" you asked for.
simianwords 2 hours ago [-]
you have an outdated view on how much it hallucinates.
UqWBcuFx6NV4r 57 minutes ago [-]
I am not anti-LLM by almost any stretch but your lack of fundamental understanding coupled with willingness to assert BS is at the point where it’s impossible to discuss anything.
You started off by asking a question, and people are responding. Please, instead of assuming that everyone else is missing something, perhaps consider that you are.
simianwords 43 minutes ago [-]
You’ve misunderstood my position and you rely on slander.
Here’s what I mean: LLMs can absolutely be directed to just search for trustable sources. You can do this yourself - ask ChatGPT a question and ask it to use sources from trustworthy journals. Come up with your own rubric maybe. It will comply.
Now, do you disagree that ChatGPT can do this much? If you do, it’s almost trivially disprovable.
One of the posters said that hallucination is a problem but if you’ve used ChatGPT for search, you would know that it’s not. It’s grounding on the results anyway a worst case the physician is going to read the sources. So what’s hallucination got to do here?
The poster also asked a question “can you ask it to not hallucinate”. The answer is obviously no! But that was never my implication. I simply said you can ask it to use higher quality sources.
Since you’ve said in asserting BS, I’m asking you politely to show me exactly what part of what I said constitutes as BS with the context I have given.
palmotea 1 hours ago [-]
The point was: will telling it to not hallucinate make it stop hallucinating?
simianwords 41 minutes ago [-]
No, but did I suggest this? I only suggested you can ask ChatGPT to rely on higher quality sources. ChatGPT has a trade off to do when performing a search - it can rely on lower quality sources to answer questions at the risk of these sources being wrong.
Please read what I have written clearly instead of assuming the most absurd interpretation.
2 hours ago [-]
olliepro 2 hours ago [-]
Much of the scientific medical literature is behind paywalls. They have tapped into that datasource (whereas ChatGPT doesn't have access to that data). I suspect that were the medical journals to make a deal with OpenAI to open up the access to their articles/data etc, that open evidence would rely on the existing customers and stickiness of the product, but in that circumstance, they'd be pretty screwed.
Do you think maybe ~10B USD to should cover all of them? For both indexing and training? Seems highly valuable.
Edit: seems like it is ~10M USD.
gip 4 hours ago [-]
I'm not really understanding why Thomson Reuters is at direct risk from AI. Providing good data streams will still be very valuable?
elemeno 3 hours ago [-]
They’re one of the two big names in legal data - Thomson Reuters Westlaw and RELX LexisNexis. They’re not just search engines for law, but also hubs for information about how laws are being applied with articles from their in house lawyers (PSLs, professional support lawyers - most big law firms have them as well to perform much the same function) that summarise current case law so that lawyers don’t have to read through all the judgements themselves.
If AI tooling starts to seriously chip away at those foundations then it puts a large chunk of their business at risk.
themgt 3 hours ago [-]
The commodification of expertise writ large is a bit mind boggling to contemplate.
2 hours ago [-]
th0ma5 2 hours ago [-]
[dead]
whitej125 3 hours ago [-]
TR will not disappear. But their value to the market was "data + interface to said data" and that value prop is quickly eroding to "just the data".
You can be a huge, profitable data-only company... but it's likely going to be smaller than a data+interface company. And so, shareholder value will follow accordingly.
palmotea 3 hours ago [-]
Seems like they should hold tight to that data (and not license it for short-term profit), so customers have to use their interface to get at it.
yodon 4 hours ago [-]
If customers start asking Claude first, before they ask Thomson Reuters, that's a big risk for the later company.
gip 3 hours ago [-]
Got it, thank you for the insight.
The assumption is that Claude has access to a stream of fresh, currated data. Building that would be a different focus for Anthropic. Plus Thomson Reuters could build an integration. Not totally convinced that is a major threat yet.
robotswantdata 4 hours ago [-]
Huge legal tech business units
epicureanideal 4 hours ago [-]
Could this lead to more software products, more competition, and more software engineers employed at more companies?
danans 2 hours ago [-]
> Could this lead to more software products, more competition, and more software engineers employed at more companies?
No, it will just lead to the end of the Basic CRUD+forms software engineer, as nobody will pay anyone just for doing that.
The world is relatively satisfied with "software products". Software - mostly LLM authored - will be just an enabler for other solutions in the real world.
falloutx 2 hours ago [-]
There are no pure CRUD engineers unless you are looking at freelance websites or fiver. Every tiny project becomes a behemoth of spaghetti code in the real world due to changing requirements.
> The world is relatively satisfied with "software products".
you can delete all websites except Tiktok, Youtube and PH, and 90% of the internet users wouldnt even notice something is wrong on the internet. We dont even need LLMs, if we can learn to live without terrible products.
fishpham 3 hours ago [-]
I think the argument is that tools like Claude Code will cause more companies to just build solutions in-house rather than purchase from a vendor.
groceryheist 3 hours ago [-]
This is correct. AI is a huge boon for open source, bespoke code, and end-user programming. It's death for business models that depend on proprietary code and products bloated with features only 5% of users use.
hugs 3 hours ago [-]
possibly also a boon for automated testing tools and infra designed for ai-driven coding.
garbawarb 3 hours ago [-]
I kind of imagine more people going off and building their own companies.
DougN7 3 hours ago [-]
I think so too. But because of code quality issues and LLMs not handling the hard edge cases my guess is most of those startups will be unable to scale in any way. Will be interesting to watch.
danans 2 hours ago [-]
Not if they don't have access to capital. Lacking that, they won't be building much of anything. And if there a lot of people seeking capital, it gets much harder to secure.
Capital also won't be rewarded to people who don't have privileged/proprietary access to a market or non-public data or methods. Just being a good engineer with Claude Code isn't enough.
rishabhaiover 4 hours ago [-]
maybe eventually, not in the near-term future.
unyttigfjelltol 4 hours ago [-]
It’s demonetizing process rent-seeking. AI can build whatever process you want, or some approximation of it.
guluarte 2 hours ago [-]
I think companies will need to step up their game and build more competitive products with more features, less buggy and faster than what people can build
PostOnce 2 hours ago [-]
If it turns out that AI isn't much more productive, it could also turn out that people still believe it is, and therefore don't value software companies.
If that happens, some software companies will struggle to find funding and collapse, and people who might consider starting a software company will do something else, too.
Ultimately that could mean less competition for the same pot of money.
I wonder.
rubyfan 1 hours ago [-]
I left software about 10 years ago for this reason. I saw engineers being undervalued, management barriers to productivity and higher compensation possibilities for non-tech functions.
reasonabl_human 18 minutes ago [-]
How do you feel about this in retrospect? Those observations sound heavily firm-dependent, but I would be interested in learning which non-tech functions offer higher compensation possibilities
roysting 2 hours ago [-]
Can this really be a kind of herding stampede behavior over Cowork? It’s been out several days now and just all the sudden today, all the traders suddenly got it into their little herd animal heads that everyone should rush to the exists… after that equally sketchy silver and gold rug pull type action last week?
Something seems quite off. Am I the only one?
retube 2 hours ago [-]
Markets are not as efficient as the textbooks would have you believe. Investors typically rely on a fairly small set of analysts for market news and views. It might take those guys a while to think about stuff, write a note etc. The deepseek crash last year lagged by several days as well.
andai 2 hours ago [-]
I'm out of the loop, but I thought there were sophisticated automated trading algorithms where people pay to install microwave antennas so they can have 1ms lower latency. And I thought those systems are hooked up to run sentiment analysis on the news. Maybe the news is late?
th0ma5 2 hours ago [-]
[dead]
arctic-true 2 hours ago [-]
It could also be that we have been in an economy-wide speculative bubble for a couple of years. Whispers of an AI bubble were a way to self-soothe and avoid the fact that we are in an everything bubble.
myth_drannon 2 hours ago [-]
Paypal fell 20% today.
quickthrowman 2 hours ago [-]
PayPal reported an earnings miss and a new CEO before market open today, that’s why it sold off.
4 hours ago [-]
Rendered at 01:03:30 GMT+0000 (Coordinated Universal Time) with Vercel.
How could it possibly keep up with LLM based search?
I believe frontier labs have no option but to go into verticals (because models are getting commoditized and capability overhang is real and hard to overcome at scale), however, they can only go into so many verticals.
Interesting. Why wouldn't an LLM based search provide the same thing? Just ask it to "use only trusted sources".
Oh so they are not just helping in search but also in curating data.
> They've got hundreds of thousands of physicians asking millions of questions everyday. None of the labs have this sort of data coming in or this sort of focus on such a valuable niche
I don't take this too seriously because lots of physicians use ChatGPT already.
There is trust and then there is accountability.
At the end of the day, a business/practice needs to hold someone/entity accountable. Until the day we can hold an LLM accountable we need businesses like OpenEvidence and Harvey. Not to say Anthropic/OpenAI/Google cannot do this but there is more to this business than grounding LLMs and finding relevant answers.
More seriously, the concept of trust is extremely lossy. The LLM is gonna lean in one direction that may or may not be correct. At the extreme, it wound likely refute a new discovery that went against what we currently know. In a more realistic version, certain AIs are more pro Zionist than others.
The thing is, LLMs are quite good at search and probably way way more strong that whatever RAG setup this company has. What failure mode are you looking at from a search perspective? Will ChatGPT just end up providing random links?
Is that sarcasm?
I think what you'll end up is a response that still relies on whatever random sources it likes, but it'll just attribute it to the "trusted sources" you asked for.
You started off by asking a question, and people are responding. Please, instead of assuming that everyone else is missing something, perhaps consider that you are.
Here’s what I mean: LLMs can absolutely be directed to just search for trustable sources. You can do this yourself - ask ChatGPT a question and ask it to use sources from trustworthy journals. Come up with your own rubric maybe. It will comply.
Now, do you disagree that ChatGPT can do this much? If you do, it’s almost trivially disprovable.
One of the posters said that hallucination is a problem but if you’ve used ChatGPT for search, you would know that it’s not. It’s grounding on the results anyway a worst case the physician is going to read the sources. So what’s hallucination got to do here?
The poster also asked a question “can you ask it to not hallucinate”. The answer is obviously no! But that was never my implication. I simply said you can ask it to use higher quality sources.
Since you’ve said in asserting BS, I’m asking you politely to show me exactly what part of what I said constitutes as BS with the context I have given.
Please read what I have written clearly instead of assuming the most absurd interpretation.
For example, only 7% of pharmaceutical research is publicly accessible without paying. See https://pmc.ncbi.nlm.nih.gov/articles/PMC7048123/
Edit: seems like it is ~10M USD.
If AI tooling starts to seriously chip away at those foundations then it puts a large chunk of their business at risk.
You can be a huge, profitable data-only company... but it's likely going to be smaller than a data+interface company. And so, shareholder value will follow accordingly.
The assumption is that Claude has access to a stream of fresh, currated data. Building that would be a different focus for Anthropic. Plus Thomson Reuters could build an integration. Not totally convinced that is a major threat yet.
No, it will just lead to the end of the Basic CRUD+forms software engineer, as nobody will pay anyone just for doing that.
The world is relatively satisfied with "software products". Software - mostly LLM authored - will be just an enabler for other solutions in the real world.
> The world is relatively satisfied with "software products".
you can delete all websites except Tiktok, Youtube and PH, and 90% of the internet users wouldnt even notice something is wrong on the internet. We dont even need LLMs, if we can learn to live without terrible products.
Capital also won't be rewarded to people who don't have privileged/proprietary access to a market or non-public data or methods. Just being a good engineer with Claude Code isn't enough.
If that happens, some software companies will struggle to find funding and collapse, and people who might consider starting a software company will do something else, too.
Ultimately that could mean less competition for the same pot of money.
I wonder.
Something seems quite off. Am I the only one?