NHacker Next
  • new
  • past
  • show
  • ask
  • show
  • jobs
  • submit
I built a page that tells you what AI model your laptop can run (localsotabenchmark.engineersf.dev)
roboror 9 minutes ago [-]
Identified every component of my system incorrectly. W11.
jrm4 4 minutes ago [-]
Interestingly wrong; probably has to do with the fingerprinting and whatnot.

I do appreciate that the "canirun" one

1) was also wrong 2) but let me pick my real card from the dropdown with results that seemed much more accurate.

Genuine question - is there literally any factor besides RAM and GPU (with VRAM info?)

jsherer 14 minutes ago [-]
I find this to be pretty accurate: https://www.canirun.ai/
not_your_vase 22 minutes ago [-]
That's not very accurate. It sees 8 GB RAM instead of 64. And it detects GTX 9 GPU, though I have an RTX30 one.

(Edit: now it came to my mind that Firefox has fingerprinting protection by default. But even after whitelisting this website, the result is the same)

spprashant 28 minutes ago [-]
For some reason it is not able to detect 64GB RAM on my Fedora Linux mini PC. It shows only 8GB.
majormunky 27 minutes ago [-]
Yeah, similar situation here, it shows 16gb on my 64gb mac
kumarski 3 hours ago [-]
and no I'm not a software develpoer - just smacked it together with minimax for personal needs.

Thought it was nifty so shared. Would love to see a real CS person's version of this and/or best prompt to build something like this accurately and keep it up to date as models advance and SOTA shifts.

nailer 34 minutes ago [-]
Great idea! You're 95% of the way there and the rest is a couple of UI tweaks.

1. I thought the table showing a bunch of models after my laptop specs would be models I could run on my laptop.

    Model Tier Example Models Params RAM Needed Your Status
    Top SOTA GPT-4o, Claude 3.5 Sonnet, Gemini Ultra 1T+ Datacenter —
    Large Models Llama 3 70B, Mistral Large, Command R+ 70B 64 GB  Usable
    Mid Models Llama 3 8B, Mistral 7B, Phi-3 Medium 7-13B 16 GB  Usable
    Small Models Phi-3 Mini, Llama 3 2B, Gemma 2B 1-3B 4 GB  Your Tier
'Your tier' is too subtle. I would make 'Your tier' highlight the ENTIRE row in some bright color to make it more obvious, and maybe fade the other rows slightly.

2. I don't know what 'usable' means. How can these models be status:usable if they are not 'my tier'? I deduce 'usable' doesn't mean usable on my laptop but I don't know what 'usable' does mean.

3. Give me links to set up the best model I can.

kumarski 29 minutes ago [-]
Thank you G!
cyanydeez 45 minutes ago [-]
One word: wrong.
nailer 37 minutes ago [-]
This isn't constructive feedback. In my case it detected my Mac's capablities accurately and gave me models to use. What was wrong about it?
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
Rendered at 19:53:24 GMT+0000 (Coordinated Universal Time) with Vercel.