Mash the bananas in a mixing bowl until most of the chunks are out. Add in the coconut milk, pure maple syrup, and vanilla extract. Mix well to combine.
Pour the banana mixture into your popsicle mold and insert the popsicle sticks. Freeze for 4 hours or overnight, or until the popsicles are frozen solid.
When you’re ready to enjoy the popsicles, thaw them for a few minutes before lifting up on a popsicle stick to release one from the mold.
Store popsicles in the popsicle mold, a freezer bag, or an airtight container for up to 2 months.