15yoe building/growing tech startup | former co-founder of ML startup WildMeta | building orbench.com

Amandine Flachs • Peerlist

orbench is a desktop app that lets you benchmark LLMs on your own tasks before you switch models.A public leaderboard ranks models on someone else's prompts. Production evals tell you the truth, but only after you've done all the work to implement it. orbench is the step in between: bring a CSV of your real tasks (or a Hugging Face dataset), pick any models on OpenRouter with their real prices, and let your own rubric grade every answer with an AI judge, a blind human review, or both.One report per run: quality score per model, p50/p95 latency, cache hit rate, and the real cost per answered task.Runs on your machine, with your own OpenRouter key. Windows, macOS, and Linux apps available.<a target="_blank" rel="noopener noreferrer nofollow ugc" class="break-all link-break text-gray-500 hover:underline" href="https://orbench.com/">orbench.com</a>

orbench: benchmark LLMs on your own tasks

Mather is a Large Language Model that serves as a mathematics tutor. It is a fine-tune of Mistral-7B-Instruct-v0.3, trained on mathematics datasets using 8x AMD MI210 on an AMD Accelerator Cloud node leveraging ROCm 6.1.1. The model can be directly used locally, without an internet connection, via a dedicated dialog user interface.

AMD Pervasive AI Contest 1st place winner - M

Pocket Garden: a multi-agent system running on multiple Arm devices to help gardeners

Arm AI Developer Challenge 2026

We used a combination of IBM's tools to answer this year's Accessibility challenge including watsonx.ai, IBM foundation model Granite, Pompt Lab, IBM cloud, Watson ML, Watson TTS and RAG.

IBM Call for code 2024 - second runner-up

Battery Spotter uses machine learning and computer vision technologies to identify batteries early on recycling facilities'conveyor belt, alert workers to pick them up, and collect data to better size and track the problem.

IBM Call for code round 2 winner

bota: an autonomous Dota 2 agent powered by GPT-OSS-20B and vLLM, created for OpenAI Open Model Hackathon. https://github.com/AmandineFlachs/bota