Accompanying website for “Quality Diversity for Synthesizer Sound Matching” submitted to DAFx 2020in21 (2021)
Animation of the Evolution
The histogram of population in BC space during a typical run is shown below. Bins with lighter color have the most individuals. The x axis is the spectral flatness (dB) and the y axis is spectral centroid (Hz). As can be seen from the animation, methods with novelty objective (NS-GC, NS-LC) explore a wider region, leading to the discovery of diverse solutions.
GA
NS-GC
NS-LC
Parameter Estimation
We show the results of sound matching (parameter estimation) with Dexed (in the parameter setting 6-ops) and u-he Diva using GA/NS-GC/NS-LC. We also show results of Dexed with vibrato enabled. The results are significantly worse, perhaps owing to the mismatch with the more natural sounds in the Nsynth dataset and the added complexity of synthesis algorithm.
WARNING: VERY LOUD SOUNDS INCLUDED! (sometimes clipping)
Dexed 6-ops
In-domain (DX7 preset) | |||
---|---|---|---|
Original | GA | NS-GC | NS-LC |
Out-of-domain (Nsynth Dataset) | |||
---|---|---|---|
Original | GA | NS-GC | NS-LC |
Diva
In-domain (Diva preset) | |||
---|---|---|---|
Original | GA | NS-GC | NS-LC |
Out-of-domain (Nsynth Dataset) | |||
---|---|---|---|
Original | GA | NS-GC | NS-LC |
Dexed 6-ops with pitch modulation
In-domain (DX7 preset) | |||
---|---|---|---|
Original | GA | NS-GC | NS-LC |
Out-of-domain (Nsynth Dataset) | |||
---|---|---|---|
Original | GA | NS-GC | NS-LC |
Quality-Diversity
Original (Out-of-domain real trumpet sound):
Best match (Red point in the BC space):
Bright (Pink):
Pure (Brown):
Noisy (Orange):