A portable ZIP version of Freemake Audio Converter would allow you to:

Extract the ZIP and launch the .exe immediately without administrative rights.

Freemake Audio Converter is a widely used tool for transforming music files between 50+ formats, extracting audio from videos, and merging tracks.