Berk Kalelioğlu
Research interests
Berk focuses on machine learning, agentic AI tools, and large and small language models (LLMs and SLMs).He is part of the AIMultiple benchmark team, conducting assessments and providing insights to help readers understand emerging technologies and their real-world applications.
Professional experience
He began his career as a Tech Project Lead at ODTU IVME-R, where he led a project to build physical quantum and pseudorandom number generators.After his tenure at IVME-R, he co-founded a game development company and released a game on Steam.
He later shifted his career toward AI and joined AIMultiple as a Researcher.
Education
Berk holds a Bachelor’s degree in Mathematics from Ankara University.Latest Articles from Berk
DecisionBench: Jev vs Kev vs LLMs
Decision models, also called System One models,1 choose an agent’s next action in a single pass instead of generating text token by token. To see whether they can make browser automation cheaper than LLMs, we ran three decision models and two LLMs, Gemini 3.8 Flash and GPT-6 Astra, on the same 50 browser tasks, for…
AIM Agentic Web Benchmark
Agents rely on web interfaces to complete tasks on the web. To measure how interface choice affects task completion, we built the AIM Agentic Web Benchmark and attempted 3,500 tasks (100 tasks completed via 7 web interfaces across 5 runs). A Bright Data interface led every run. The Bright Data CLI retrieved 8 more tasks…
Agentic IT: Can AI Agents Design a Benchmark
We tested 16 models on a benchmark design in text-to-SQL and tool calling. Each model built one benchmark per topic, for a total of 32 submissions. No submission passed every rubric criterion. The agents could build and run tests, but none demonstrated both a blank-answer test and a correct-answer test of their own scorer. Text-to-SQL…
AIM Enterprise: Agentic Enterprise Benchmark
Enterprises use LLMs every day for their regular tasks. To find the most cost-efficient LLMs, we designed AIM Enterprise, an agentic enterprise benchmark, where we used 69 real enterprise tasks across strategy, marketing, HR, sales, and operations. Two judge models scored every file that passed the checks. On 32.7% of the individual scores the two…
AI Deep Research: Codex vs Claude vs Grok vs Exa
A deep research tool answers a question with a written report instead of a page of links. We ran five ways of producing one over the same 20 business research briefs and scored every report against rules written before the runs to find the best tool for deep research. Four of the five are coding…
Best Flat-Rate LLM API Providers
Flat-rate LLM providers sell unlimited model usage for a fixed monthly price instead of billing per token. This model spread because agentic coding sessions can use tens of millions of tokens, so a per-token bill is hard to predict. Very few providers offer a true flat fee; most plans marketed as flat carry a usage…
AI VC Benchmark: 16 AI Agents on Client Identification
Client identification is part of commercial due diligence. We tested 16 models on client-list research for three research and review sites, one of them AIMultiple, scoring their submissions against answer keys we compiled and the pages they cited. We did not set reasoning effort for any model. Each ran at its agent program’s default, and…
OpenClaw Alternatives: Hermes vs ZeroClaw vs Grok Bot
Autonomous AI agents, such as OpenClaw and Hermes agent, automate multi-step tasks that would normally require constant human input. While OpenClaw has become the most widely adopted always-on autonomous agent, many users are seeking alternatives due to its challenging deployment process and complex configuration requirements. We provide 5 leading OpenClaw alternatives, highlighting their key capabilities…
Computer Use Agents: Benchmark & Architecture
Computer-use agents operate real desktops and web apps. Their designs, limits, and trade-offs are often unclear. We break down how leading systems work, how they learn, and how their architectures differ. We also reference a focused UI-grounding benchmark on 100 desktop screenshots, across 4 task types and 5 runs per sample. It isolates the quality…
MCP Gateway Benchmark: Latency & Security of 6 Gateways
An MCP gateway sits between an AI agent and the tools it calls, and vendors position it as the security layer for that traffic. We benchmarked six MCP gateways against one instrumented backend on a single box, measuring added latency, per-tool authorization, content protection, and audit completeness. A product appears against a control only if…
AIMultiple Newsletter
1 free email per week with the latest B2B tech news & expert insights to accelerate your enterprise.