Make the Dough:
In a large bowl, combine flour, sugar, and salt. Cut in cold butter using a pastry cutter or fork until the mixture resembles coarse crumbs. Mix in water and vanilla until dough comes together. Divide into two discs, wrap in plastic wrap, and refrigerate for at least 30 minutes.
Roll Out Dough:
On a floured surface, roll each disc into a rectangle about 1/8 inch thick. Cut each rectangle into smaller rectangles, approximately 3x4 inches.
Assemble Pop-Tarts:
Place a teaspoon of strawberry jam in the center of half of the rectangles, leaving a border around the edges. Brush edges with water, then place a second rectangle on top. Press edges with a fork to seal.
Bake:
Preheat oven to 375°F (190°C). Place pop-tarts on a parchment-lined baking sheet. Bake for 20–25 minutes, or until golden brown. Remove from oven and cool slightly.
Glaze:
In a small bowl, whisk together powdered sugar, milk, and vanilla until smooth. Drizzle over warm pop-tarts and add sprinkles if desired. Let glaze set before serving.