MLCommons https://mlcommons.org/ Better Machine Learning for Everyone Wed, 28 Aug 2024 02:52:19 +0000 en-US hourly 1 https://wordpress.org/?v=6.5.5 https://mlcommons.org/wp-content/uploads/2023/11/mlcommon-icon-back-w-75x75.jpg MLCommons https://mlcommons.org/ 32 32 New MLPerf Inference v4.1 Benchmark Results Highlight Rapid Hardware and Software Innovations in Generative AI Systems https://mlcommons.org/2024/08/mlperf-inference-v4-1-results/ Wed, 28 Aug 2024 14:56:00 +0000 https://mlcommons.org/?p=3155 New mixture of experts benchmark tracks emerging architectures for AI models

The post New MLPerf Inference v4.1 Benchmark Results Highlight Rapid Hardware and Software Innovations in Generative AI Systems appeared first on MLCommons.

]]> Mixtral 8x7B: a new MLPerf Inference benchmark for mixture of experts https://mlcommons.org/2024/08/moe-mlperf-inference-benchmark/ Wed, 28 Aug 2024 14:54:00 +0000 https://mlcommons.org/?p=3212 MLPerf task force shares insights on the design of its mixture of experts large language model benchmark

The post Mixtral 8x7B: a new MLPerf Inference benchmark for mixture of experts appeared first on MLCommons.

]]> SDXL: An MLPerf Inference benchmark for text-to-image generation https://mlcommons.org/2024/08/sdxl-mlperf-text-to-image-generation-benchmark/ Wed, 28 Aug 2024 14:45:00 +0000 https://mlcommons.org/?p=3197 MLPerf task force shares insights on the design of its text-to-image benchmark

The post SDXL: An MLPerf Inference benchmark for text-to-image generation appeared first on MLCommons.

]]> Comprehensive Open Federated Ecosystem (COFE) Presented at ISBI 2024 https://mlcommons.org/2024/08/medperf-cofe-isbi-2024/ Mon, 05 Aug 2024 15:00:00 +0000 https://mlcommons.org/?p=2907 MLCommons Medical working group demonstrates COFE at ISBI

The post Comprehensive Open Federated Ecosystem (COFE) Presented at ISBI 2024 appeared first on MLCommons.

]]> Announcing the results of the inaugural AlgoPerf: Training Algorithms benchmark competition https://mlcommons.org/2024/08/mlc-algoperf-benchmark-competition/ Thu, 01 Aug 2024 19:29:45 +0000 https://mlcommons.org/?p=3009 Non-diagonal preconditioning has dethroned Nesterov Adam, and our self-tuning track has crowned a new state-of-the-art for completely hyperparameter-free training algorithms

The post Announcing the results of the inaugural AlgoPerf: Training Algorithms benchmark competition appeared first on MLCommons.

]]> MLCommons AI Safety Working Group’s Rapid Progress to a v1.0 Release https://mlcommons.org/2024/07/mlc-ais-v1-0-progress/ Wed, 31 Jul 2024 16:38:28 +0000 https://mlcommons.org/?p=2932 Building a comprehensive approach to measuring the safety of LLMs and beyond

The post MLCommons AI Safety Working Group’s Rapid Progress to a v1.0 Release appeared first on MLCommons.

]]> MLCommons Leadership Evolution https://mlcommons.org/2024/06/mlcommons-leadership-evolution/ Wed, 26 Jun 2024 20:52:43 +0000 https://mlcommons.org/?p=2811 New leadership structure reflects our growing role in the global AI ecosystem

The post MLCommons Leadership Evolution appeared first on MLCommons.

]]> MLCommons AI Safety prompt generation expression of interest. Submissions are now open! https://mlcommons.org/2024/06/ai-safety-prompt-generation-eoi/ Thu, 20 Jun 2024 22:44:44 +0000 https://mlcommons.org/?p=2768 MLCommons is looking for prompt generation suppliers for its v1.0 AI Safety Benchmark Suite. This will be for a paid opportunity.

The post MLCommons AI Safety prompt generation expression of interest. Submissions are now open! appeared first on MLCommons.

]]> Introducing the 2024 MLCommons Rising Stars https://mlcommons.org/2024/06/2024-mlc-rising-stars/ Thu, 20 Jun 2024 16:11:34 +0000 https://mlcommons.org/?p=2672 Fostering a community of talented young researchers at the intersection of ML and systems research

The post Introducing the 2024 MLCommons Rising Stars appeared first on MLCommons.

]]> MLCommons and AVCC Release Automotive Benchmark Proof-of-Concept https://mlcommons.org/2024/06/automotive-benchmark-poc/ Tue, 18 Jun 2024 15:50:00 +0000 https://mlcommons.org/?p=2604 MLPerf Automotive Benchmark POC release is the first step toward a comprehensive benchmark suite for autonomous vehicles

The post MLCommons and AVCC Release Automotive Benchmark Proof-of-Concept appeared first on MLCommons.

]]>