Justin Bieber and wife Hailey Baldwin Bieber celebrated Easter together!

On Sunday, Hailey, 27, shared a series of photos on her Instagram Story of how the couple marked the annual springtime holiday.

In one post, two large chocolate eggs with Hailey and Justin’s names written in white icing could be seen placed in baskets.

Another post showed Hailey posing with a filter that added bunny ears to the top of her head. “Happy Easter,” she wrote with the image.

Justin, 30, and Hailey’s faith has long bonded them together since they wed in 2018.

Back in February, the pair was spotted attending a late-night church service at the Churchome Church at Saban Theatre in Los Angeles, hours after Hailey’s father, Stephen Baldwin, publicly shared a post that featured a prayer request for the famous couple.

The Rhode founder sported a neon yellow argyle sweater and a pair of oversized jeans, which she accessorized with a pair of tinted sunglasses, a black leather purse and a bright red lip.

The “Yummy” singer wore a gray hooded sweatshirt and cream-colored trousers and was bundled up with a black scarf wrapped around his head.

Never miss a story — sign up for PEOPLE’s free daily newsletter to stay up-to-date on the best of what PEOPLE has to offer, from celebrity news to compelling human interest stories.

Earlier in the day on Feb. 28, the Usual Suspects star, 57, shared a post from Victor Marx, the founder of All Things Possible Ministries, which featured Justin strumming the guitar and singing along to “I Could Sing of Your Love Forever” by Delirious? and Hillsong Worship.

“Christians, please when you think of Justin & Hailey, take a moment to offer a little prayer for them to have wisdom, protection and to draw close to the Lord,” read the caption on the clip, per the New York Post‘s Page Six.