Understanding Automatic Mixing
A Subtask-Oriented Analysis of Two-Stage Mixing Systems
Abstract
Automatic mixing transforms multitrack recordings into perceptually coherent, balanced, and aesthetically consistent mixes. However, in real-world production, this task is challenging due to large track counts, diverse instrumentation, and strong inter-track dependencies. Two-stage systems address this complexity by separating intra-group processing from inter-group mixing, yet it remains unclear whether their gains arise from stronger component models or from explicit task decomposition. We present a subtask-oriented analysis of automatic mixing through three controlled listening experiments. We investigate whether full-mix models transfer to intra-group mixing, whether downstream models compensate for grouping and loudness errors, and whether two-stage decomposition improves full-mix quality. Across three dense pop, rock, and metal excerpts, transfer differs between the evaluated models; inappropriate grouping causes clear downstream degradation, while altered loudness relationships have weaker and model-dependent effects. Both two-stage variants significantly outperform their corresponding single-stage baselines. These findings support explicit separation of local balance and global mix coordination as a useful design principle for automatic mixing.
Three Research Questions
Can models trained for full mixing transfer to intra-group mixing? See Experiment 1 demos.
Can downstream models compensate for incorrect grouping and loudness relationships? See Experiment 2a and 2b.
Does explicit two-stage decomposition improve full-mix quality? See Experiment 3 demos.
Grouping functions, intra-group processors, and inter-group models can be varied independently. See the grouping-rules documentation.
Two-Stage Framework
A grouping function partitions the input multitrack into functional groups. Intra-group processing produces group-level stems, which are then combined by an inter-group model into the final mix. This contrasts with a monolithic full-mix model that generates the final mix directly from the raw tracks. The framework is used purely as a controlled analysis scaffold — it is not itself proposed as a new mixing system.
Models Evaluated
| Model | Role | Description |
|---|---|---|
| ELL | Intra-group | Equal Local Loudness — training-free, rule-based intra-group balancing. |
| Diff-MST | Full-mix / intra-group / inter-group | Predicts gain, EQ, compression, and panning via a differentiable mixing console. |
| MEGAMI | Full-mix / intra-group / inter-group | Conditional generative model producing coordinated track-level effect representations. |
| NoMix | Control | Shared preprocessing only, no further processing — unprocessed control condition. |
Citing
A camera-ready citation will be added once the paper is published. In the meantime, please reference the GitHub repository:
https://github.com/SparrowReivun/TwoStageMixingAnalysis