The lack of transparency here is wild. They aggregate the scores of the models they test against, which obscures the performance. They only release results on their own internal benchmark that they won't release. They talk about RL training but they don't discuss anything else about how the model was trained, including if they did their own pre-training or fine-tuned an existing model. I'm skeptical of basically everything claimed here until either they share more details or someone is able to interpedently benchmark this.
criemen 16 hours ago [-]
I understand where you're coming from, and I'd love to have learned about pre-training vs. off-the-shelf base model too.
But
> their own internal benchmark that they won't release
If they'd release their internal benchmark suite, it'd make it into the training set of about every LLM, which from a strictly scientific standpoint, invalidates all conclusions drawn from that benchmark from then on. On the other hand, not releasing the benchmark means they could've hand-picked the datapoints to favor them. It's a problem that can't be resolved unfortunately.
cwyers 12 hours ago [-]
I'm not saying SWE-Bench is perfect, and there are reports that suggest there is some contamination of training sets for LLMs with common benchmarks like SWE-Bench. But they publish SWE-bench so anyone can run it and have an open leaderboard where they attribute the results to specific models, not just vague groupings:
ARC-AGI-2 keeps a private set of questions to prevent LLM contamination, but they have a public set of training and eval questions so that people can both evaluate their modesl before submitting to ARC-AGI and so that people can evalute what the benchmark is measuring:
Cursor is not alone in the field in having to deal with issues of benchmark contamination. Cursor is an outlier in sharing so little when proposing a new benchmark while also not showing performance in the industry standard benchmarks. Without a bigger effort to show what the benchmark is and how other models perform, I think the utility of this benchmark is limited at best.
nickpsecurity 12 hours ago [-]
In high-security systems, we solved this problem with trusted, independent evaluators who got all the data. They replicate the results themselves. They analyze every artifact for flaws. They also pen test the system offensively. If they say it's good, then maybe it is good or maybe less, obviously bad.
We could have third-party groups with evaluation criteria who don't make models or sell A.I.. Strictly evaluators. Alternatively, they have a different type of steady income with the only A.I. work they're doing being evaluation.
infecto 2 hours ago [-]
Disagree. The ultimate bar which is easily measurable, do users find value in it. Benchmarks are mostly meaningless especially in my opinion where cursor shines which is the tool chain. You can go try composer yourself today and see if it’s valuable to you.
diggan 2 hours ago [-]
Isn't that up to the reader/visitor/user to decide? As it stands right now, Cursor are publishing results they won't say how they got them, and compares them against aggregate scores we don't know the true results of, and you're saying "it doesn't matter, the tool is better anyways".
Then why publish the obscured benchmarks in the first place then?
NitpickLawyer 7 hours ago [-]
Does it really matter tho? At the end of the day, what matters most is if real users find it useful or not. And cursor has that data (both historically and in real-time). Thousands of accepts/rejects >>> any benchmark that you can come up with. That should allow them to iterate on it, and make it better, eventually.
Benchmarks have become less and less useful. We have our own tests that we run whenever a new model comes out. It's a collection of trivial -> medium -> hard tasks that we've gathered, and it's much more useful to us than any published table. And it leads to more interesting finds, such as using cheaper models (5-mini, fast-code-1, etc) on some tasks vs. the big guns on other tasks.
I'm happy to see cursor iterate, as they were pretty vulnerable to the labs leaving them behind when all of them came out with coding agents. The multi-agents w/ built in git tree support is another big thing they launched recently. They can use their users as "teacher models" for multiple completions by competing models, and by proxying those calls, they get all the signals. And they can then use those signals to iterate on their own models. Cool stuff. We actually need competing products keeping eachother in check, w/ the end result being more options for us, and sometimes even cheaper usage overall.
jonasnelle 23 hours ago [-]
Cursor has the best Tab model, and I feel like their lead there has kept growing - they're doing some really cool things there. https://cursor.com/blog/tab-rl
I wonder how much the methods/systems/data transfer, if they can pull off the same with their agentic coding model that would be exciting.
srush 23 hours ago [-]
We also are big Tab users here at Cursor. In the blog we talk about the motivation for this project came from thinking about a Tab-like agent.
enraged_camel 22 hours ago [-]
Tab model is fantastic but I wish it was somehow aware of the conversation happening in the currently active AI chat session.
vidarh 22 hours ago [-]
I feel like that's like having a lead in producing better buggy whips.
I run Claude Code in the background near constantly for a variety of projects, with --dangerously-skip-permissions, and review progress periodically. Tabbing is only relevant when it's totally failing to make progress and I have to manually intervene, and that to me is a failure scenario that is happening less and less often.
camdenreslink 20 hours ago [-]
What are you building with this workflow? Is it an application live in production with users? It is such a foreign way of working to me.
vidarh 17 hours ago [-]
A compiler (hobby project). A web application server (tooling for my consultancy). An agentic framework to part-automate end-to-end development of a large web app (customer project). An analytics platform to analyze infrastructure maturity (customer project).
Usually I'll have several Claude Code sessions running in parallel on different projects, and when one of them stops I will review the code for that project and start it again - either moving forwards or re-doing things that have issues.
anonzzzies 9 hours ago [-]
We build mostly everything with this workflow, and we indeed have a lot of paid applications in production with users. Most what we do is SaaS. We do have rigid human code reviews though.
lubujackson 20 hours ago [-]
This is just a completely different use of LLMs and has little to do with working at a real business with a live site and users. Cursor is great when you want to gain understanding of an issue quickly, or resolve something clear and specific quickly.
I'm not against YOLO vibe coding, but being against tab completion is just insane to me. At the end of the day, LLMs help you achieve goals quicker. You still need to know what goal you want to achieve, and tab completion basically let's me complete a focused goal nearly as soon as I determine what my goal is.
vidarh 17 hours ago [-]
Some of these projects are at a "real business with a live site and users". Two of the current ones are.
And it's not remotely "YOLO vibe coding". All the code gets reviewed, and tested thoroughly, and they are worked to specs, and gated by test suites.
What I don't do is babysit the LLM until it's code passes both the test suite and automated review stages, because it's a waste of time.
Others of these projects are research tasks. While I wrote this comment, Claude unilaterally fixed a number of bugs in a compiler.
mbrock 4 hours ago [-]
To be clear, Claude probably also introduced the bugs?
I tried to use an appropriate emoji to express the joking nature of this comment, but HN silently filtered it out, so pretend you see a grinning face.
dagss 22 hours ago [-]
It's great. BUT: Wish they had selected another shortcut like shift+tab.
Every time I write code myself I find myself racing the AI to get an indentation in before the AI is done... gets annoying
RosalieCodes 22 hours ago [-]
You can change the key bind, I personally set it to ctrl+tab
TiredOfLife 7 hours ago [-]
Have you tried Windsurfs?
typpilol 8 hours ago [-]
What makes it and different from vscodes copilot completions?
srush 23 hours ago [-]
Hi everyone,
I am an ML researcher at Cursor, and worked on this project. Would love to hear any feedback you may have on the model, and can answer question about the blog post.
coder543 18 hours ago [-]
Impressive systems write-up. A question: if Composer is an RL finetune on an open model, why keep weights closed? The edge from a slightly better checkpoint erodes quickly in this market, it's not a durable advantage. Composer protects Cursor's margins from being squeezed by the big AI labs, but that is true whether the weights are open or closed, and I think Cursor would have more lasting benefit by generating developer goodwill than from a narrow, short-lived advantage. But, that's just my opinion. I personally find it hard to get excited about yet-another proprietary model. GPT-5 and Sonnet 4.5 are around when I need one of those, but I think the future is open.
Agingcoder 15 hours ago [-]
It's stunning.
I don't use these tools that much ( I tried and rejected Cursor a while ago, and decided not to use it ) but having played with GPT5 Codex ( as a paying customer) yesterday in regular VSCode , and having had Composer1 do the exact same things just now, it's night and day.
Composer did everything better, didn't stumble where Codex failed, and most importantly, the speed makes a huge difference. It's extremely comfortable to use, congrats.
Edit: I will therefore reconsider my previous rejection
srush 14 hours ago [-]
Awesome to hear, I will share with the team.
embedding-shape 19 hours ago [-]
Do you have any graphs handy that kind of replicates the one used first in the blog post but a bit less ambiguous, maybe without model grouping? I feel like it would have been a bit more fair to include proper names, and individualize them rather than group everything together by something, and then present your own model on its own.
WanderPanda 22 hours ago [-]
Why did you stop training shy of the frontier models? From the log plot it seems like you would only need ~50% more compute to reach frontier capability
srush 22 hours ago [-]
We did a lot of internal testing and thought this model was already quite useful for release.
WanderPanda 22 hours ago [-]
Makes sense! I like that you guys are more open about it. The other labs just drop stuff from the ivory tower. I think your style matches better with engineers who are used to datasheets etc. and usually don't like poking a black box
srush 22 hours ago [-]
Thanks! I do like the labs blog posts as well though, OpenAI and Anthropic have some classics.
chaidhat 22 hours ago [-]
Which model did you distill it from? Great work! PS getting a few scenarios where it doesn't follow rules as well as sonnet 4.5
srush 22 hours ago [-]
The blog talks about the training process. Specifically we trained with RL post-training on coding examples.
chis 21 hours ago [-]
Makes sense, but what model was used for the base? Is it some open-source model, and you're not at liberty to disclose?
chaidhat 21 hours ago [-]
that's cool thanks!
dlojudice 15 hours ago [-]
Congratulations on your work. I spent the day working with a mix of the Composer/Sonnet 4.5/Gemini 2.5 Pro models. In terms of quality, the Composer seems to perform well compared to the others. I have no complaints so far. I'm still using Claude for planning/starting a task, but the Composer performed very well in execution.
What I've really enjoyed is the speed. I had already tested other fast models, but with poor quality. Composer is the first one that combines speed and quality, and the experience has been very enjoyable to work with.
alyxya 22 hours ago [-]
Is the new model trained from scratch? What training data went into it?
dfltr 22 hours ago [-]
Is it true that Cheetah is Grok Code Fast 2? Does this mean that the new Cursor model is also based on Grok?
srush 22 hours ago [-]
Cheetah was an earlier (and dumber) version of this model that we used to test production speed. They are both developed in-house. If you liked Cheetah, give this model a try.
carlosbaraza 21 hours ago [-]
This is nice. I liked Cheetah for grunt work that I want to get out quickly and is not too hard. The speed is really awesome. A model that would run at even higher speeds like the OSS models at groq/cerebras would really be workflow changing, because the slowness of SOTA models really breaks the flow. I find myself taking a ton of breaks and getting distracted while I wait for a model to complete a task (e.g. just now).
srush 21 hours ago [-]
Let us know how you like it.
dfltr 22 hours ago [-]
Awesome, thanks for the clarification. So are the rumors around Cheetah being based on a Grok model just straight up untrue? I want to try Composer but have a pretty strict no X/Grok policy.
is Composer a fine tune of an existing open source base model?
srush 22 hours ago [-]
Our primary focus is on RL post-training. We think that is the best way to get the model to be a strong interactive agent.
comex 22 hours ago [-]
So, yes, but you won’t say what the base model is? :)
typpilol 8 hours ago [-]
It seems like a sort of sonnet model as a lot of people are reporting it like to spam documentation on Twitter like sonnet 4.5
ripped_britches 16 hours ago [-]
Amazing work! The UX is great.
GPT-5-codex does more research before tackling a task, that is the biggest weakness for me not using Composer yet.
Could you provide any color on whether ACP (from zed) will be supported?
smg 19 hours ago [-]
Can you please tell us more about how you used Ray for setting up the RL infrastructure?
srush 19 hours ago [-]
Oh good question. Actually speaking at the Ray Summit next week in SF so we will talk more about it. We used Ray throughout the pipeline for running evals, for the RL controller, for data collation, and for visualizations. One tool we found helpful was Ray Data which let us easily scale over data and run logs.
nvartolomei 19 hours ago [-]
Please share more about Ray Data use case.
srush 18 hours ago [-]
We use Ray data for our map-style processing jobs. For example one tool have runs over all the rollouts from the RL system and collects qualitative statistics to understand which type of agent trajectories are being reward, and what types of searches and terminal commands are being made.
juanma0216 20 hours ago [-]
I prefer the approach of focusing on faster models despite their lower intelligence because I want my IDE to fly when I can see the code. I find this useful when I need to manually debug something that any model is able to do, so I know it's going to fail but at least it will fail fast. On the other hand, if I need more intelligence I have my other CLI that doesn't allow me to see the code but gets the planning and difficult code done.
srush 20 hours ago [-]
Our view is that there is a now a minimal amount of intelligence that is necessary to be productive, and that if you can pair that with speed that is awesome.
nickpsecurity 12 hours ago [-]
What's funny is there's many industries outside A.I. that pick their talent the same way. ;)
az226 21 hours ago [-]
How many times have you needed to reset the optimizer during the RL training cycles?
carlosbaraza 21 hours ago [-]
How do you work with multiple agents?
srush 20 hours ago [-]
We train with a single agent. is that the question?
jasonjmcghee 23 hours ago [-]
Maybe I'm an outlier but Sonnet 4.5 quality is about as low as I'm willing to go.
It's generation speed is not the problem or the time sink.
It's wrestling with it to get the right output.
---
And just to clarify as maybe I misunderstood again but people are comparing cursor to Claude Code and codex etc here- isn't this whole article all cursor just using different models?
swyx 22 hours ago [-]
> Sonnet 4.5 quality is about as low as I'm willing to go.
literally a 30 day old model and you've moved the "low" goalpost all the way there haha. funny how humans work
leemoore 2 hours ago [-]
Not sure about parent, but my current bar is set by GPT-5 high in codex cli. Sonnet 4.5 doesn't quite get there in many of the use cases that are important to me. I still use sonnet for most less intelligence phases and tasks (until I get crunched by rate limits). But when it comes to writing the final coding prompt and the final verification prompt and executing a coder or a verifier that will execute and verify well it's GPT 5 high all the way. Even if sonnet is better at tool calling, GPT 5 High is just smarter and has better coding/engineering judgement and that difference is important to me. So I very much get the sentiment of not going below sonnet intelligence 4.5 for coding. It's where I draw the line too.
jasonjmcghee 22 hours ago [-]
Yup - just like sibling comment said - my "low bar" is going to be whatever the best model is that isn't unreasonably costly/expensive.
Speed of model just isn't the bottleneck for me.
Before it I used Opus 4.1, and before that Opus 4.0 and before that Sonnet 4.0 - which each have been getting slightly better. It's not like Sonnet 4.5 is some crazy step function improvement (but the speed over Opus is definitely nice)
JanSt 2 hours ago [-]
I think Opus 4.1 is still much better than Sonnet 4.5
vidarh 22 hours ago [-]
Yes? Because why should we settle for less now that it is available?
swyx 22 hours ago [-]
because engineering is the art of "good enough" and composer is clearly "good enough but a lot faster" which makes up for intelligence gaps in interesting ways
tomashubelbauer 6 hours ago [-]
For me the bar for barely good enough is and always has been Codex. Before I found frontier models more trouble than they're worth. And there is still a massive amount of room to grow before I can genuinely say working with these tools is more enjoyable than frustrating for me and now I use them (and how I think they should work).
vidarh 22 hours ago [-]
It's not good enough for a lot of us, though, clearly.
alyxya 22 hours ago [-]
There’s two different kinds of users, on one side people are more hands off and want the model to autonomously handle longer tasks on its own with minimal guidance, and on the other side is users who want to interactively collaborate with the model to produce desired results. Speed matters much more for the second case, where you know what you want and just want the model to implement whatever you had in mind as quick as possible. Intelligence/ability matters more for the first case when you don’t have full understanding of all the code. I think it’s context dependent for me where more serious work tends to be more interactive. The intelligence of a model doesn’t make up for issues due to lack of context to me.
jasonjmcghee 21 hours ago [-]
I'm very solidly in the second group - but I review all the code. If it writes faster than I can read, that's fast enough.
srush 22 hours ago [-]
Agree that Sonnet 4.5 is an excellent model. Would be curious to hear your experience using Composer though, it's quite good.
jasonjmcghee 22 hours ago [-]
I'll try it out! I haven't yet - just generally conveying my opinion that I personally weigh "better model" much more important than speed, assuming some "fast enough"
Also, didn't realize you worked at Cursor - I'm a fan of your work - they're lucky to have you!
srush 21 hours ago [-]
Thanks! Yeah, been working here for 9 months now. Fascinated byt agentic coding both as a researcher and user.
Totally agree that "smart model" is the table stakes for usefulness these days.
timcobb 12 hours ago [-]
> Composer though, it's quite good
Wow, no kidding. It is quite good!
timcobb 20 hours ago [-]
Same... I've found that using a non-Claude model just ends up being more expensive and not worth it. "Auto" tokens are hardly free, and I've had plenty of experiences putting "Auto" to work on a "simple" seeming task to have it consume like 1 USD of tokens quite quickly while producing nothing of value, when I'd replay with Claude 4.5 Sonnet non-thinking and it would provide a solid solution for 0.5 USD.
solarkraft 22 hours ago [-]
The reason I pulled out the comparison is to highlight how serious they are about all the important parts that make or break the AI coding experience - speed being very important to me. I’d rather catch my model doing the wrong thing quickly than having a higher chance of one-shotting it at the cost of having to do a lot of specification upfront.
NaomiLehman 18 hours ago [-]
gpt-5-high is as low as i can go :]
stared 23 hours ago [-]
While I am excited to see a new model, I am skeptical when there is so much vagueness - charts with "frontier models" without actually spelling out which ones, charts with no numbers (time axis, or in one chart - entirely).
srush 22 hours ago [-]
There is a footnote that should help with the models. Training is a harder thing to report on, but roughly our finding here is that RL scales.
solarkraft 23 hours ago [-]
People on here love to be contrarian about Cursor, but I’ve tried all the popular alternatives (Copilot, Claude Code, Codex, Gemini CLI, Cline) and found Cursor’s overall experience to just be unmatched. A big part of that is its speed, another its reliability.
It’s the only coding agent I’m actually really motivated to use out of the box because it really does make me feel more productive while the others keep messing up the project, from way too large changes I didn’t ask for all the way to constant syntax and request errors.
It’s the only coding agent I’ve used that feels serious about being a product rather than a prototype. Their effort in improving their stack is totally paying off.
pqdbr 23 hours ago [-]
I dropped cursor for the precise reason you mention: reliability.
Countless times my requests in the AI chat just hang there for 30+ seconds more until I can retry them.
When I decided to give Claude Code a try (I thought I didn't need it because I used Claude in Cursor) I couldn't believe how faster it was, and literally 100% reliable.
EDIT: given today's release, decided to give it a go. The Composer1 model _is_ fast, but right at the second new agent I started I got this:
> Connection failed. If the problem persists, please check your internet connection or VPN
infecto 21 hours ago [-]
Sounds like you have a network problem. Did you try checking the network diagnostic in settings? They default to http2 which can throw a wrench in some corporate networks.
I would be willing to bet money your issue is on your side. I am a daily user since the beginning and cannot recall when I have had issues like you describe unless it was related to my corp network.
davidgomes 22 hours ago [-]
A lot of progress is being made here on the Cursor side I encourage you to try it again.
(Cursor dev)
cleak 22 hours ago [-]
This is the exact reason I left Cursor for Claude Code. Night and day difference in reliability. The Windows experience might be especially bad, but it would get constantly hung or otherwise fail when trying to run commands. I also had to babysit Cursor and tell it to continue for mid sized tasks.
jonasnelle 22 hours ago [-]
They've improved performance dramatically in the last few weeks, might have fixed your issues.
hobs 22 hours ago [-]
Its clear they've been shipping a lot of windows updates.
cleak 9 hours ago [-]
It does seem significantly better on Windows. I'll give it another chance over the next couple weeks.
chasebank 22 hours ago [-]
I use cursor daily, my business partner uses CC. Without a doubt, CC is certainly better, I'm just not willing to let go of the flow I spent the last year fine tuning. I'll probably make the leap after we finish the latest release.
saberience 5 hours ago [-]
I used Cursor for the total of one day (paid for a year subscription), discovered Claude Code later that day and havent opened Cursor since.
Note, later I started using Codex and now Codex is my daily driver, Claude Code for problems where Codex fails (not many), and again Cursor is never used.
They were the first mover but Codex (in my opinion) blows Cursor up into 1000 tiny pieces. It's just so, so much better.
infecto 21 hours ago [-]
I too have tried them all and have settled with Cursor being the best. That said I see the current space split between folks like me who know generally what I want built and appreciate a tool that helps me get to goal quicker and on the otherwise of the spectrum, folks who want the tool to orchestrate most of the engineering. I have no opinion on which is better but for me I sit on the first camp. In that camp Cursor is by far the best tool.
psygn89 22 hours ago [-]
Yep, it just works seamlessly. Sure, it hangs sometimes, but their UI allows you to retry or undo changes to an earlier point in the conversation easily. The autocompletion is nice as well and pretty satisfying to tab through the small and menial things when refactoring.
rtfeldman 22 hours ago [-]
> I’ve tried all the popular alternatives (Copilot, Claude Code, Codex, Gemini CLI, Cline)
Can't help but notice you haven't tried Zed!
ramon156 22 hours ago [-]
You tried Claude and still prefer cursor?
solarkraft 22 hours ago [-]
Absolutely. CC can be tuned to not do too much crap on its own, but even with the new extension its IDE integration and multi thread management are still significantly worse, as is its status reporting, which I find to be very important.
Also, somehow magically, I’ve found Cursor’s Auto mode to be significantly faster than the specific models I’ve tried, Claude being among them.
infecto 22 hours ago [-]
Auto is pretty amazing and I think most folks that have issues or complain about cost are simply not using Auto.
lubujackson 21 hours ago [-]
Auto had a big improvement a few weeks ago (around when pricing changed)
infecto 19 hours ago [-]
If a few weeks is months I would agree I think the change to Auto was 2-3+ months ago when they moved to charging named models and higher limits on Auto.
enraged_camel 21 hours ago [-]
Auto is only good for trivial stuff at this point. It is quite subpar at everything else. Th is is probably because it almost always defaults to Claude Sonnet 3.5 (which you can tell if you ask the agent to identify itself and tell you its version), and that is pretty outdated.
infecto 19 hours ago [-]
Again it goes back to what your workflow is. I don’t think trivial is the right word. I use auto to write fairly advanced code but I do it in bite size chunks or relatively bite size. So thinking function level or a couple of interdependent functions ruins being written.
I would agree it is not as good on doing lengthy work where it’s taking design all the way through implementing a feature in a single shot but trivial is not a good description.
I also don’t think you’re right. 3.5 was recently deprecated and even before then, Cursor has been hitting rate limits with Anthropic. Auto is as much a token cost optimization as it is a rate limit optimization.
infecto 22 hours ago [-]
Absolutely. I actually don’t understand the preference folks have for Claude code. I don’t find it that powerful. That said, I think some of it comes down to preference and work context.
OsrsNeedsf2P 23 hours ago [-]
One thing no competitor is serious on is average response completion time. Cursor lapped everyone there
srush 21 hours ago [-]
There are lots of good models we like here. But we agree that getting the right point on the smart+fast graph can make agentic coding feel really good.
(Cursor researcher)
nu11ptr 23 hours ago [-]
I love Cursor. I've tried Copilot/Claude/etc. but keep coming back to Cursor. I just want to work, and Cursor tab complete is dang accurate, esp. for refactoring tasks.
Sammi 23 hours ago [-]
I tried going back to VS Code + Copilot a month ago. I only lasted 4 days because it was to bad. It was super slow and gave poor suggestions, but mostly it just flat out did not suggest anything. Cursor feels snappy in comparison and the suggestions are more often than not useful. The most annoying thing about Cursor tab complete, is that it is so fast that when I am doing something unusual then it will keep on jumping in with useless suggestions. They have a snooze function for this though.
WanderPanda 22 hours ago [-]
Damn TIL, I always used > Cursor: disable completions and forgot to turn it on again
I need to try snooze then!
toobulkeh 8 hours ago [-]
I used the new system tonight and it felt like a definite downgrade. Generated a few non-working basic apps, couldn’t handle CSS in a NextJS environment. Terminal context didn’t work. And it went back to not reasoning through the problem until resolution. And kept slowing down.
I’m assuming major release vs stable, but this is pretty lackluster so far. Switched back to Sonnet reasoning. Here’s to improving!
I think both Cursor and Cognition and going in the same direction of SWE-grep[0].
SWE-grep was able to hit ~700tokens/s and Cursor ~300token/s, hard to compare the precision/recall and cost effectiveness though, considering SWE-grep also adopted a "hack" of running it on Cerebras.
I'm trying to kickstart a RL-based code search project called "op-grep" here[1], still pretty early, but looking for collaborators!
hehe thanks! as a self taught AI engineer, might take awhile =D
neuronexmachina 21 hours ago [-]
For anyone else who was wondering, it looks like the within-Cursor model pricing for Cursor Composer is identical to gemini-2.5-pro, gpt-5, and gpt-5-codex: https://cursor.com/docs/models#model-pricing
($1.25 input, $1.25 cache write, $0.13 cache read, and $10 output per million tokens)
lubujackson 20 hours ago [-]
I'm curious if their near-term expectation is that this is be better than these models or is this a model they tend to use in Auto mode, or if the focus is really if you want speed...? I guess my question is why would I actively chose this over Auto?
ciphix 4 hours ago [-]
The metrics in the post seem quite abstract. Does anyone know the detailed metrics of this mysterious model? Was it fine-tuned from open models or trained from scratch?
ianberdin 5 hours ago [-]
Feels like the comments are fighting of prepaid influencers.
koakuma-chan 14 hours ago [-]
I just gave it a try and it's reaally fast. Didn't expect this from you Cursor, good job.
carlosbaraza 22 hours ago [-]
Could anyone explain how to use multiple agents and subagents in Cursor, Claude Code, or others? It is already challenging to me taming one model doing work, let alone synchronizing multiple parallel workers.
Do you have to split the plan in parallelizable tasks that could be worked in parallel in one codebase without breaking and confusing the other agents?
asdev 22 hours ago [-]
you can use git worktrees and just have multiple Claude Code terminal instances working on each worktree. That way they don't clash, just delete the worktree when the task is done.
carlosbaraza 21 hours ago [-]
I have never leveraged git worktrees... That is such a crazy useful tool that I am almost ashamed of not having researched it before. Git is such a beautiful piece of software.
I love cursor, the tab completion and agent mode. But I really dislike vscode after using intellij for so many years. I really wish the underlying editor was better, or I could get cursor features in intellij instead. The editing of the files is mostly fine, but its everything else around it that a full IDE provides thats just so much better. Right now its intellij + claude code for me, and its fine, but I wish I could get the AI power of cursor in a better package.
Jcampuzano2 19 hours ago [-]
Building off of VSCode was probably Cursors silver bullet and the best decision they could have ever made.
It made migrating for everyone using VSCode (probably the single most popular editor) or another vscode forked editor (but at the time it was basically all VSCode) as simple as install and import settings.
I do not think Cursor would have done nearly as well as it has if it didn't. So even though it can be subpar in some areas due to VSCodes baggage, its probably staying that way for a while.
netcraft 18 hours ago [-]
I dont disagree with anything you said. If I was in their shoes, I would have done exactly the same thing.
Maybe my complaint is that I wish vscode had more features like intellij, or that intellij was the open source baseline a lot of other things could be built on.
Intellij is not without its cruft and problems, dont get me wrong. But its git integration, search, navigation, database tools - I could go on - all of these features are just so much nicer than what vscode offers.
pbowyer 18 hours ago [-]
Intellij's tab-complete is coming along; it's hit and miss if it will work but for similar edits I'm finding it picks up the pattern quickly and I can tab - tab - tab to make them happen.
Still not up to Cursor standards though :)
kilroy123 23 hours ago [-]
What I can't stand about cursor is the constantly changing and confusing billing and usage.
I think competition in the space is a good thing, but I'm very skeptical their model will outperform Claude.
80hd 22 hours ago [-]
Insane velocity from the Cursor team. I wonder how they move so fast?
I would have thought it's because you use Cursor...
carlosbaraza 22 hours ago [-]
Cursor 2.0 keeps crashing on me while having an agent running and opening the IDE part of the application. I might have to rollback.
amilich 21 hours ago [-]
Hey - really sorry to hear this - could you email me andrew@cursor.com? Here are 3 suggestions to try-
1. Reset your settings.json - if shared with vscode, sometimes settings can cause perf regressions
2. Could you try cmd-shift-p -> "capture and send debugging data"? Will send us some profiling data to debug
3. Clear your user data (will delete chats) as a last resort - cmd-shift-p, "reveal user data," close the app, then delete this folder and restart the app
Jayakumark 20 hours ago [-]
This looks like a model RLed on top of Qwen3-Coder or GLM 4.6 as per their graph and foot note.
my very small nit is... why is the model called Composer?? of all things?? when there was already a Cursor Composer from 2024.
Cursor Cheetah wouldve been amazing. reusing the Composer name feels like the reverse OpenAI Codex move haha
srush 22 hours ago [-]
We like the name Composer and were sad to see it go. Excited to bring it back. (Agree Cheetah is a cool name too.)
timcobb 20 hours ago [-]
I wish it was easy to find out how much it costs relative to Claude :)
sebdufbeau 20 hours ago [-]
As a stealth model, it was priced as $1.25M in / $10M out
Right now, it seems free when you are a Cursor Pro user, but I'd love more clarity on how much it will cost (I can't believe it'll be unlimited usage for subscribers)
Jcampuzano2 2 hours ago [-]
A bit late but it's actually not free. You can see it on their models page. It's similarly priced to GPT-5 and Gemini 2.5 Pro.
Facts. They really need to make pricing more clear across the entire product.
asdev 22 hours ago [-]
is Cursor Bench open? Would like to see an open benchmark for agentic coding
srush 21 hours ago [-]
Unfortunately not, as we used our own internal code for the benchmark. We would also like to see more benchmarks that reflect the day-to-day agentic coding use.
gabriel666smith 20 hours ago [-]
Is there any information at all available, anywhere, on what Cursor Bench is testing and how?
It's the most prominent part of the release post - but it's really hard to understand what exactly it's saying.
srush 18 hours ago [-]
Roughly, we had Cursor software engineers record real questions they were asking models, and then had them record the PR that they made that contained the result. We then cleaned these up. That is the benchmark.
gabriel666smith 6 hours ago [-]
Are you able to give a sense of how many questions, which domains they were split over, and how that split looked in % terms?
As a user, I want to know - when an improvement is claimed - whether it’s relevant to the work I do or not. And whether that claim was tested in a reasonable way.
These products aren’t just expensive - it requires switching your whole workflow. Which is becoming an increasingly big ask in this space.
It’s pretty important for me to be able to understand, and subsequently, believe a benchmark - I find it really hard not to read it as ad copy where this information isn’t present.
ukblewis 18 hours ago [-]
Which programming languages/tools/libraries did the teams questions/code involve?
alyxya 23 hours ago [-]
I wonder if this custom model is trained on cursor users. There’s a lot of potential on how much better a custom model could be the closer it is integrated with the product. Having the model learn to adapt to different user preferences would make it stand out compared to memoryless frontier models.
Sammi 23 hours ago [-]
The fact that you are wondering this is bad. You definitely should know this. _ALL_ the online ai providers are training on your data. They have more expensive enterprise plans if want to opt out.
alyxya 23 hours ago [-]
I’ve generally seen providers allow you to opt in or out. What may vary is what the default is and what they may offer in exchange for using your data (perhaps they could offer higher rate limits).
numbers 22 hours ago [-]
Please keep the naming of your models sane, I'd like to know that composer 1 is the first model and composer 2 is second but composer 1o is not yet another 1 variant that's actually newer and better than 2, that's just dumb. Not that you're doing that, some other companies do that.
srush 21 hours ago [-]
We will do our best. Luckily I don't think there are major telecom companies called Composer-2.
ibash 23 hours ago [-]
Very cool, congrats!
bn-l 16 hours ago [-]
Same price as GPT-5
romanovcode 23 hours ago [-]
Where is the comparison with Sonnet 4.5? That would be the only thing that matters, really.
matheist 23 hours ago [-]
> "Best Frontier" includes GPT-5 and Sonnet 4.5, which both outperform Composer.
yodon 23 hours ago [-]
>> "Best Frontier" includes GPT-5 and Sonnet 4.5, which both outperform Composer.
Looking at the graph, it would appear there's an implicit "today" in that statement, as they do appear poised to equal or surpass Sonnet 4.5 on that same benchmark in the near future.
ciphix 3 hours ago [-]
What Cursor is really emphasizing here is speed — they’re claiming it runs about four times faster than GPT-5/Sonnet, while still offering roughly the same level of performance.
timcobb 20 hours ago [-]
Does anyone code with GPT-5? I've never had it work in Cursor. I mean, like, at all.
srush 18 hours ago [-]
A lot of people use it! It scores very well on our benchmarks, significantly better than Composer-1.
Rendered at 15:24:47 GMT+0000 (Coordinated Universal Time) with Vercel.
> their own internal benchmark that they won't release
If they'd release their internal benchmark suite, it'd make it into the training set of about every LLM, which from a strictly scientific standpoint, invalidates all conclusions drawn from that benchmark from then on. On the other hand, not releasing the benchmark means they could've hand-picked the datapoints to favor them. It's a problem that can't be resolved unfortunately.
https://www.swebench.com/
ARC-AGI-2 keeps a private set of questions to prevent LLM contamination, but they have a public set of training and eval questions so that people can both evaluate their modesl before submitting to ARC-AGI and so that people can evalute what the benchmark is measuring:
https://github.com/arcprize/ARC-AGI-2
Cursor is not alone in the field in having to deal with issues of benchmark contamination. Cursor is an outlier in sharing so little when proposing a new benchmark while also not showing performance in the industry standard benchmarks. Without a bigger effort to show what the benchmark is and how other models perform, I think the utility of this benchmark is limited at best.
We could have third-party groups with evaluation criteria who don't make models or sell A.I.. Strictly evaluators. Alternatively, they have a different type of steady income with the only A.I. work they're doing being evaluation.
Then why publish the obscured benchmarks in the first place then?
Benchmarks have become less and less useful. We have our own tests that we run whenever a new model comes out. It's a collection of trivial -> medium -> hard tasks that we've gathered, and it's much more useful to us than any published table. And it leads to more interesting finds, such as using cheaper models (5-mini, fast-code-1, etc) on some tasks vs. the big guns on other tasks.
I'm happy to see cursor iterate, as they were pretty vulnerable to the labs leaving them behind when all of them came out with coding agents. The multi-agents w/ built in git tree support is another big thing they launched recently. They can use their users as "teacher models" for multiple completions by competing models, and by proxying those calls, they get all the signals. And they can then use those signals to iterate on their own models. Cool stuff. We actually need competing products keeping eachother in check, w/ the end result being more options for us, and sometimes even cheaper usage overall.
I wonder how much the methods/systems/data transfer, if they can pull off the same with their agentic coding model that would be exciting.
I run Claude Code in the background near constantly for a variety of projects, with --dangerously-skip-permissions, and review progress periodically. Tabbing is only relevant when it's totally failing to make progress and I have to manually intervene, and that to me is a failure scenario that is happening less and less often.
Usually I'll have several Claude Code sessions running in parallel on different projects, and when one of them stops I will review the code for that project and start it again - either moving forwards or re-doing things that have issues.
I'm not against YOLO vibe coding, but being against tab completion is just insane to me. At the end of the day, LLMs help you achieve goals quicker. You still need to know what goal you want to achieve, and tab completion basically let's me complete a focused goal nearly as soon as I determine what my goal is.
And it's not remotely "YOLO vibe coding". All the code gets reviewed, and tested thoroughly, and they are worked to specs, and gated by test suites.
What I don't do is babysit the LLM until it's code passes both the test suite and automated review stages, because it's a waste of time.
Others of these projects are research tasks. While I wrote this comment, Claude unilaterally fixed a number of bugs in a compiler.
I tried to use an appropriate emoji to express the joking nature of this comment, but HN silently filtered it out, so pretend you see a grinning face.
Every time I write code myself I find myself racing the AI to get an indentation in before the AI is done... gets annoying
I am an ML researcher at Cursor, and worked on this project. Would love to hear any feedback you may have on the model, and can answer question about the blog post.
I don't use these tools that much ( I tried and rejected Cursor a while ago, and decided not to use it ) but having played with GPT5 Codex ( as a paying customer) yesterday in regular VSCode , and having had Composer1 do the exact same things just now, it's night and day.
Composer did everything better, didn't stumble where Codex failed, and most importantly, the speed makes a huge difference. It's extremely comfortable to use, congrats.
Edit: I will therefore reconsider my previous rejection
GPT-5-codex does more research before tackling a task, that is the biggest weakness for me not using Composer yet.
Could you provide any color on whether ACP (from zed) will be supported?
It's generation speed is not the problem or the time sink.
It's wrestling with it to get the right output.
---
And just to clarify as maybe I misunderstood again but people are comparing cursor to Claude Code and codex etc here- isn't this whole article all cursor just using different models?
literally a 30 day old model and you've moved the "low" goalpost all the way there haha. funny how humans work
Speed of model just isn't the bottleneck for me.
Before it I used Opus 4.1, and before that Opus 4.0 and before that Sonnet 4.0 - which each have been getting slightly better. It's not like Sonnet 4.5 is some crazy step function improvement (but the speed over Opus is definitely nice)
Also, didn't realize you worked at Cursor - I'm a fan of your work - they're lucky to have you!
Totally agree that "smart model" is the table stakes for usefulness these days.
Wow, no kidding. It is quite good!
It’s the only coding agent I’m actually really motivated to use out of the box because it really does make me feel more productive while the others keep messing up the project, from way too large changes I didn’t ask for all the way to constant syntax and request errors.
It’s the only coding agent I’ve used that feels serious about being a product rather than a prototype. Their effort in improving their stack is totally paying off.
Countless times my requests in the AI chat just hang there for 30+ seconds more until I can retry them.
When I decided to give Claude Code a try (I thought I didn't need it because I used Claude in Cursor) I couldn't believe how faster it was, and literally 100% reliable.
EDIT: given today's release, decided to give it a go. The Composer1 model _is_ fast, but right at the second new agent I started I got this:
> Connection failed. If the problem persists, please check your internet connection or VPN
I would be willing to bet money your issue is on your side. I am a daily user since the beginning and cannot recall when I have had issues like you describe unless it was related to my corp network.
(Cursor dev)
Note, later I started using Codex and now Codex is my daily driver, Claude Code for problems where Codex fails (not many), and again Cursor is never used.
They were the first mover but Codex (in my opinion) blows Cursor up into 1000 tiny pieces. It's just so, so much better.
Can't help but notice you haven't tried Zed!
Also, somehow magically, I’ve found Cursor’s Auto mode to be significantly faster than the specific models I’ve tried, Claude being among them.
I would agree it is not as good on doing lengthy work where it’s taking design all the way through implementing a feature in a single shot but trivial is not a good description.
I also don’t think you’re right. 3.5 was recently deprecated and even before then, Cursor has been hitting rate limits with Anthropic. Auto is as much a token cost optimization as it is a rate limit optimization.
(Cursor researcher)
I’m assuming major release vs stable, but this is pretty lackluster so far. Switched back to Sonnet reasoning. Here’s to improving!
SWE-grep was able to hit ~700tokens/s and Cursor ~300token/s, hard to compare the precision/recall and cost effectiveness though, considering SWE-grep also adopted a "hack" of running it on Cerebras.
I'm trying to kickstart a RL-based code search project called "op-grep" here[1], still pretty early, but looking for collaborators!
[0]: https://cognition.ai/blog/swe-grep [1]: https://github.com/aperoc/op-grep
($1.25 input, $1.25 cache write, $0.13 cache read, and $10 output per million tokens)
Do you have to split the plan in parallelizable tasks that could be worked in parallel in one codebase without breaking and confusing the other agents?
It made migrating for everyone using VSCode (probably the single most popular editor) or another vscode forked editor (but at the time it was basically all VSCode) as simple as install and import settings.
I do not think Cursor would have done nearly as well as it has if it didn't. So even though it can be subpar in some areas due to VSCodes baggage, its probably staying that way for a while.
Maybe my complaint is that I wish vscode had more features like intellij, or that intellij was the open source baseline a lot of other things could be built on.
Intellij is not without its cruft and problems, dont get me wrong. But its git integration, search, navigation, database tools - I could go on - all of these features are just so much nicer than what vscode offers.
Still not up to Cursor standards though :)
I think competition in the space is a good thing, but I'm very skeptical their model will outperform Claude.
[1] https://www.businessinsider.com/no-shoes-policy-in-office-cu...
other links across the web:
https://x.com/amanrsanger/status/1983581288755032320?s=46
https://x.com/cursor_ai/status/1983567619946147967?s=46
Cursor Cheetah wouldve been amazing. reusing the Composer name feels like the reverse OpenAI Codex move haha
Right now, it seems free when you are a Cursor Pro user, but I'd love more clarity on how much it will cost (I can't believe it'll be unlimited usage for subscribers)
https://cursor.com/docs/models#model-pricing
It's the most prominent part of the release post - but it's really hard to understand what exactly it's saying.
As a user, I want to know - when an improvement is claimed - whether it’s relevant to the work I do or not. And whether that claim was tested in a reasonable way.
These products aren’t just expensive - it requires switching your whole workflow. Which is becoming an increasingly big ask in this space.
It’s pretty important for me to be able to understand, and subsequently, believe a benchmark - I find it really hard not to read it as ad copy where this information isn’t present.
Looking at the graph, it would appear there's an implicit "today" in that statement, as they do appear poised to equal or surpass Sonnet 4.5 on that same benchmark in the near future.