# Peirce in the Machine: How Mixture of Experts Models Perform Hypothesis Construction

Preprint · Bruce Rushing

- Archive id: arxiv:2406.17150
- Published: 2024-06-24
- DOI: https://doi.org/10.1017/psa.2025.10159
- arXiv: https://arxiv.org/abs/2406.17150
- Source URL: https://arxiv.org/abs/2406.17150
- PDF: https://arxiv.org/pdf/2406.17150
- Provenance: arxiv

## Abstract

Mixture of experts is a prediction aggregation method in machine learning that aggregates the predictions of specialized experts. This method often outperforms Bayesian methods despite the Bayesian having stronger inductive guarantees. We argue that this is due to the greater functional capacity of mixture of experts. We prove that in a limiting case of mixture of experts will have greater capacity than equivalent Bayesian methods, which we vouchsafe through experiments on non-limiting cases. Finally, we conclude that mixture of experts is a type of abductive reasoning in the Peircian sense of hypothesis construction.

_Abstract reproduced under CC0-1.0 (arXiv descriptive metadata)._

---
Space Kitty Archive · https://space-kitty.com · API: https://space-kitty.com/api/v1 · MCP: https://space-kitty.com/mcp · Premium: $0.20/request via x402 (Base Sepolia (testnet)). Metadata: arXiv (CC0), OpenAlex (CC0), Europe PMC (CC BY/CC0 works), ClinicalTrials.gov.