It depends on what result you need from the "rocking chair". If you gain muscle mass, then it is better to do one thing, because bodybuilding and crossfit have different training principles.
You will just waste a bunch of calories, you may become "leaner", but significant results in both endurance and strength (and muscle mass) will be difficult to achieve. It is also worth remembering that in the early stages you can easily overtrain.
Choose a specific target for yourself and move only in its direction, and all other directions will only interfere.
But this does not mean that this should not be done. If you get a kick out of it, then please. The results will be, but they will be less pronounced than if you were doing something in particular.
P.S. Buy a good heart rate monitor and go to the CrossFit gym only with it. Excessive acidification of the myocardium will not lead to anything good.