Actually your Quest befits the all down long time method followed on the "Linux From Scratch" Project. something I've wanted in self to attempt. This describes using your own basic version choice distro.
look around here there is one very kind soul to whom generated a Simple Stripped down Slim Version of MX.. respin
This would proudly promote your tools in base for such a project. Possibly in sense of learning the all inner and outer features of a well born Distro. MX has its quarks but in all it is a very top notch featured Distro. Mint too is also very good over all. yet not to ever see it has a Minimal version bare minimal per say . yet Mint does still support its own. LMDE ( Linux Mint Debian Edition ) which really is the Mint Frame work on top of its Primary Debian oppose to having another base layer of Ubuntu as is the main Mint release based on which is also based on Debian. (so possibly call this that Image of slim down)
MX is based on Debian. I don't have my other system fired up but I did download and load into a VBox session this Slim MX version.
One can check
https://www.linuxfromscratch.org/lfs/index.html
Sure to Exhibit the grand point on this project. immense and worthy for the time to endure the learn curve. Ending you will like all your efforts by the result. Food for thought!.
trying MX 23.5 Minimal Respin to find the link to post for you to getting started. this Image alone might also satisfy your base start to have MX on a Base Debian minimal for no apps basics xfce D/T.
( lots of respins - file to look for is
MX-23.5_minimal_x64.iso 
