In this article, we obtain the exact distribution of a linear combination of bilateral gamma (BG) random variables (r.v.s). Next, we discuss the distributional properties of the linear combination of BG r.v.s, including probability density function, cumulant generating function and characteristic function. A Stein characterization is developed, which leads us to several distributional approximation results with explicit error bounds in both Kolmogorov and Wasserstein distances. Related limit theorems are also discussed. Furthermore, we show that the associated Lévy processes are finite-variation processes with BG distributed increments having random parameters. Finally, we apply our results in exponential stock models.