Achieving a level of practical usefulness with a muzzle-loading rifle of old times was not a trivial task. It was a specialized field, which is why it was given only to special troops until about the 1840s-ish.
The OP makes some generous claims about the smoothbore musket. Its trajectory was almost entirely random. Hitting something at 100 yards and beyond was simply left to chance. The chief instructor for the British Army's School of Musketry, Colonel Ernest Wilford, in the 1850s made several comments to the effect that hitting an intended target at 300 yards was essentially impossible.
Granted, the smoothbore was used in only a simple manner. The typical infantry smoothbore had no sights and the soldiers closed their eyes and opened their mouths when they fired (due to the flash from the pan, and the noise). Beyond 100 yards it was about useless, but within that range a volley could be devastating. That's also why early artillery was so important: it handled fires beyond 200 yards.
Early riflemen required special training and had their pros and cons on the battlefield. The cons were considerable, such that Napoleon himself didn't see the value of riflemen.
One of the first issues was ballistics: the early rifle was accurate, but its muzzle velocity was lower than a smoothbore because the ball encountered so much resistance when being stuck in the rifle grooves (most smoothbores had high velocity because the ball was undersized to the barrel by a generous amount, and therefore contacted the barrel only a couple times on its journey). Riflemen were therefore working with a pronounced arc - a repeatable arc, but a big arc nonetheless. Working with it was a skill earned through experience, and was a skill set that the common infantry training regimes never touched.
There was also the problem of how to load a weapon in the muzzle, whose main virtue was that the ball engaged the rifling. You had to engage the rifling on the way DOWN. Early riflemen used a slightly oversized ball and would use a mallet to get the bullet formed into the barrel - you can recognize early paintings of them with the mallet in their belt. Or, they could use a slightly undersized ball with various patches, paper or leather (if you had a leather shirt or pants with wide frills, you could cut off a frill for a patch). The temperature of the barrel also came into it, with a cold barrel being a tighter fit. Therefore, you could find riflemen with various sizes of ball to choose from, depending on their circumstances, and also possibly needing to blank-fire it a couple times to warm up the barrel. Being a rifleman was an art, not a science.
The end result was that a rifle was much slower to load than line infantry, and more finicky to use. Its only virtue was that it was accurate, but only if the riflemen knew what he was doing, usually with knowledge that came from somewhere other than the standard infantry training regime.
As it turned out, rifles wouldn't become common until the technology of the rifle approached the simplicity of the smoothbore musket, and this was generally accomplished by the Minie ball.
All info for this post is from:
The Destroying Angel. Brett Gibbons. 2019. No publisher given in my copy.