Have a look at the ArmHF image here:
You could replace the root file system from that card with the Debian server one.
To make an installer card, just take our default installer image and replace the .tar.zx in /home/oem with one containing your root file system. There is also a script in that directory to create such a tarball from a filesystem on the SSD for instance.
You could just keep using the Debian ArmHF system, as it should provide everything you need from the server edition.
Also, you can expect an update to ArmHF soon...
Johan Dams, Genesi USA Inc.
Director, Software Engineering
Yep, I have a blog... PurpleAlienPlanet