What I actually need is attribute the conversion to the first referrer in the first visit instead.
This feature should do exactly just what you want. if you find it does not work, please create bug report with steps to reproduce the issue: https://github.com/piwik/piwik/issues