The standard weak lensing formalism assumes that the lensing map relating the observed image of a source to its intrinsic shape depends only on the deflection angle. We show that this description is incomplete beyond linear perturbation theory, even when only scalar perturbations are present at first order. Using the Jacobi map formalism, we derive expressions for the rotation field, shear B-modes, and their angular power spectra at second order in relativistic perturbation theory. In the standard formalism, rotation and shear B-modes share the same spectrum, however, this degeneracy is broken once the parallel transport of the Sachs basis is consistently taken into account. We quantify this correction numerically, finding a difference of about $5\%$ on large angular scales $\ell \sim 5$ for sources at redshift $z_\mathrm{s} = 0.5$. We also investigate frame-dragging effects, which are usually neglected in weak lensing. We present the first analytical derivation of the corresponding impact on the angular power spectrum of shear B-modes and show that it becomes the dominant contribution on scales $\ell \lesssim 10$. While both Sachs-basis rotation and frame dragging significantly affect shear B-modes on large scales, their effect on the observed galaxy ellipticity is of order $1\%$, making these nonlinear relativistic corrections challenging to detect in practice. Our results are supported by relativistic simulations of weak lensing observables, including the first numerical study of frame dragging in the power spectra of the lensing convergence and cosmic shear.