Are there mobile desktops for Debian?
If you just want the DE and to configure everything else yourself, you can always just install phosh or sxmo on top of a debian/raspbian installation.
Mobian/Droidian are targeted for smartphone SoCs, so they would take a lot of tinkering to get runnin on an RPi
If you want a full OS that's already configured to be a smartphone-like device, something like Glodroid may be your best bet. They're an infrequent updater, the only reason I mention them is because they can target Broadcom devices (like RPis)
If you don't mind getting away from building the hardware yourself, and just want a phone that you can run linux on, FairPhone/PinePhone/Librem 5 seem to be the way to go
Aside from that, afaict you're in for designing your own device from extant components and then crowd-funding to pay for a factory line to assemble it for you (this is essentially what the PinePhone did)