The local group of dinghy sailors sails a wide variety of boats. As we launch from the same spot at the same time, it's easy to make comparisons. My impression is that all the crews need about the same time for rigging and unrigging their boats, with little difference (as long as the boats have the same number of sails).
That said, I have a single-sail, 8' dinghy with an unstayed mast that I can rig in 10 minutes. If you want to select a boat based on how quickly you can rig it, the factors to consider would be an unstayed mast (no need to connect forestay and shrouds) with a single, loose-footed main that's "sleeved" around the mast (no need for halyards or threading bolt-ropes).
The minute you add a jib and stays, and use halyards to raise your sails, the number of steps to rig your boat goes up considerably. A smaller boat for the same rig type just means the spars are shorter and lighter, making if physically a bit easier, but you will still need to assemble the same puzzle.
What does help is to not disassemble everything. During the season I leave the jib sheets connected (the attache with a soft-shackle to the clew) and I leave the main on the book (rolled up, but not rolled around) and the main sheet connected as well. That saves about 5 minutes - and as nature abhors a vacuum, I now use that time to rig the spinnaker
My prediction, the Javelin would not be that much faster to rig, but you might find it physically easier. Unless the latter is a gating item for you, consider whether it would be a better boat - for example, it might be easier to single-hand as your weight would be more effective as movable ballast.