You probably won't have the best luck with it unless you can find a
print-only driver for the all-in-one machine and install it on your office
computer (the one you'll be connecting TO using remote desktop). If that
doesn't make it work, you might have to use that same print-only driver at
your home office. This likely means that you'll lose the other functions of
the all-in-one device, even when you're not connected to the office.
If you haven't actually bought the all-in-one machine yet, I would recommend
that you not. Problems like these keep cropping up (for example, if you have
more than one computer in the house, with a home network, you'll have a very
interesting time trying to get your other computer to print to an
all-in-one). You can do everything that an all-in-one does using a printer, a
scanner, a fax modem, and a little know-how.