From training to serving: Reflection’s Beam on CoreWeave

Reflection used Weights & Biases Models within CoreWeave Forge to develop Beam. Together with Axolotl, we’ve validated supervised fine-tuning on CoreWeave infrastructure. Developers can run the released model through Serverless Inference in CoreWeave Forge on Day 0.
From training to serving: Reflection’s Beam on CoreWeave

Reflection’s first open-weight model, Beam, is available on Day 0 through Serverless Inference in CoreWeave Forge. Developers can call it through an OpenAI-compatible API, pay per token, and begin evaluating coding and agentic workloads without provisioning GPUs or operating a serving cluster.

Beam’s path on CoreWeave spans training, post-training, and serving. Reflection used Weights & Biases Models within Forge during training. We’ve validated a supervised fine-tuning (SFT) use case with Axolotl on CoreWeave infrastructure, and Serverless Inference in Forge provides Day 0 access to the released model.

This release adds a new model to the Western open-weight ecosystem, with an Apache 2.0 license and a specific focus: software engineering and long-horizon, tool-driven tasks.

What Reflection built into the Beam open-weight model

Beam is a mixture-of-experts model with 501 billion total parameters and 23 billion active parameters per token. Each token activates a fraction of the model, reducing computation relative to activating every parameter. Serving still needs to account for the full model’s weights, so active parameter count alone does not determine memory requirements or latency.

Reflection built this release for text-native workloads: source code, tool calls, logs, documents, and structured outputs. Beam is built for two workloads: software engineering and long-horizon agentic tasks, including resolving GitHub issues, maintaining code, and completing workflows through repeated model calls and tool interactions.

Beam’s approximately one-million-token context window provides room for extensive code and task history. The context length exposed by an inference endpoint depends on the provider’s serving configuration, so developers should check the supported limit when designing their workflows.

Beam ships under Apache 2.0 without custom license terms. Developers and researchers can inspect the weights, fine-tune the model, and choose their deployment environment. The release advances the Western open-weight ecosystem with a model teams can adapt to their own coding and agentic workloads.

From training to post-training Beam on CoreWeave

Reflection used Weights & Biases Models within Forge during Beam’s training. Open weights extend that development path to teams adapting the released model to their own workloads.

Together with Axolotl, we’ve validated a supervised fine-tuning (SFT) use case for Beam on CoreWeave infrastructure. SFT trains the model on examples of desired behavior, giving teams a way to adapt its responses to a specific task or domain. For coding and agentic applications, those examples could capture repository conventions, expected tool-call formats, or domain-specific instructions. The use case starts with Beam’s open checkpoint and applies supervised fine-tuning through Axolotl on CoreWeave. In the validated run, Axolotl  fine-tuned Beam-1.0-501B-A23B on GPU kernel generation, training it on about 84 million tokens of PyTorch-to-Triton and CUDA examples from the open KernelBook and AI CUDA Engineer datasets. Training used LoRA adapters with expert parallelism across 16 NVIDIA B200 GPUs on two CoreWeave nodes and finished in 73 minutes. For a second use case, medical question answering, Axolotl trained LoRA adapters directly on Beam's NVFP4 checkpoint on a single B200 node, using APO-Zero preference optimization on rubric-scored examples of Beam's own answers to patient questions. Because the adapters are trained to survive requantization, they fold back into an NVFP4 checkpoint that serves on Blackwell in the same format as the base NVFP4 model. On HealthBench, where scores across a year of frontier model releases sit within a few points of each other, the merged model's score rose from 49.0% to 52.7% across all 5,000 conversations (graded with GPT-6 Luna Decisions), and the improvement held up after length adjustment and under every grader tested. 

These were demo runs, the results illustrate what's possible and do not represent Beam's full potential with fine-tuning. CoreWeave is exploring broader support for fine-tuning and reinforcement learning with Beam, including further work with Axolotl on online RL. Enterprises interested in post-training Beam with their own data can contact CoreWeave to discuss their requirements.

Start building with Beam on Serverless Inference

Serverless Inference provides an OpenAI-compatible endpoint with per-token billing. That API compatibility simplifies integration with clients and frameworks that support the interface. Model behavior still needs evaluation: prompt conventions, tool calling, output formatting, and failure recovery can differ between models. Tracing, evaluations, and observability with CoreWeave Agent Lens help teams inspect Beam across application execution. For an agent, the useful unit of analysis is the complete task, including model calls, tool responses, retries, and final output.

For coding and agentic workloads, evaluate:

  • Task success: whether the model produces a correct patch or completes the workflow, with results checked against tests or explicit acceptance criteria
  • Tool-use reliability: whether it selects the appropriate tool, generates valid arguments, and recovers from errors
  • Completion time: elapsed time across all model calls and tool interactions
  • Cost per successful task: token spend across the workflow, including unsuccessful attempts and retries

These measurements distinguish a model that performs well on isolated prompts from one that works reliably inside your application. Start with the managed endpoint, evaluate Beam against your coding and agentic workloads, and identify where fine-tuning could improve performance for your application.

Get started with Beam on CoreWeave Serverless Inference

Try CoreWeave Forge with a 30 free trial of Pro

To explore fine-tuning Beam with your own data or reinforcement learning for your workload, contact the CoreWeave team to discuss your requirements  and for an evaluation through CoreWeave ARENA or on your CoreWeave cluster.

Contact Us

‍

From training to serving: Reflection’s Beam on CoreWeave

Reflection’s open-weight Beam model on CoreWeave spans training with Weights & Biases Models, SFT in partnership with Axolotl, and Day 0 API access on Serverless Inference in CoreWeave Forge.

Related

Inference,
Copy code
Copied!
Inference,