Srimad-Bhagavatam: Canto 10 - Chapter 1 - Verse 4
न लब्धो दैवहतयोर्वासो नौ भवदन्तिके ।यां बाला: पितृगेहस्था विन्दन्ते लालिता मुदम् ॥ ४ ॥
na labdho daiva-hatayorvāso nau bhavad-antikeyāṁ bālāḥ pitṛ-geha-sthāvindante lālitā mudam
Deprived by fate, We could not live with you and enjoy the pampered happiness most children enjoy in their parents’ home.
Here Lord Kṛṣṇa points out that not only did His parents suffer in separation from Him and Balarāma, but the two boys also suffered in separation from Their parents.