Multigrid methods are known to be highly efficient and scalable preconditioners, not only for single-field problems but also for mortar methods ranging from contact mechanics to meshtying problems. An interesting application in this field is the mixed-dimensional coupling of slender beam structures embedded into three-dimensional solid bodies. Such beam/solid interactions can be found in several engineering scenarios (e.g. fiber-reinforced composite materials or reinforced concrete). Imposing the coupling constraints via a penalty method as proposed in leads to an ill-conditioned and highly non-diagonal dominant matrix. Solving such problems in an efficient and scalable manner with iterative solvers is difficult and makes an appropriate preconditioning essential. Using algebraic multigrid methods (AMG) in this context is yet again challenging as there are several open questions regarding AMG for beams and the coarsening of the mixed-dimensional coupling terms. This talk will discuss a physics-based block preconditioning approach based on AMG. The outer block iteration is taken care of with an approximate block factorization. A crucial part of the calculation is the approximation of the inverse appearing in the Schur complement. Using a sparse approximate inverse approach based on an appropriate sparsity pattern helps to retain a low iteration number and parallel scalability. Multilevel ideas are used to approximate the block inverses appearing in the system. We will assess the performance and the weak scalability of the proposed block preconditioner using examples of the interaction of solids with torsion-free Kirchhoff-Love and Simo-Reissner beam finite elements.