As far as I know in Synology creating new volume requires deleting all data on the disk. I haven't tried :)
I've just noticed that 5.2 firmware works fine with SMB so I was able to create new user in Synology with space limit 200GB and now it seems to work properly.