QDSynthWebpage

Accompanying website for “Quality Diversity for Synthesizer Sound Matching” submitted to DAFx 2020in21 (2021)

Animation of the Evolution

The histogram of population in BC space during a typical run is shown below. Bins with lighter color have the most individuals. The x axis is the spectral flatness (dB) and the y axis is spectral centroid (Hz). As can be seen from the animation, methods with novelty objective (NS-GC, NS-LC) explore a wider region, leading to the discovery of diverse solutions.

GA

NS-GC

NS-LC

Parameter Estimation

We show the results of sound matching (parameter estimation) with Dexed (in the parameter setting 6-ops) and u-he Diva using GA/NS-GC/NS-LC. We also show results of Dexed with vibrato enabled. The results are significantly worse, perhaps owing to the mismatch with the more natural sounds in the Nsynth dataset and the added complexity of synthesis algorithm.

WARNING: VERY LOUD SOUNDS INCLUDED! (sometimes clipping)

Dexed 6-ops

In-domain (DX7 preset)
Original GA NS-GC NS-LC
Out-of-domain (Nsynth Dataset)
Original GA NS-GC NS-LC

Diva

In-domain (Diva preset)
Original GA NS-GC NS-LC
Out-of-domain (Nsynth Dataset)
Original GA NS-GC NS-LC

Dexed 6-ops with pitch modulation

In-domain (DX7 preset)
Original GA NS-GC NS-LC
Out-of-domain (Nsynth Dataset)
Original GA NS-GC NS-LC

Quality-Diversity

hi

Original (Out-of-domain real trumpet sound):

Best match (Red point in the BC space):

Bright (Pink):

Pure (Brown):

Noisy (Orange):