Preheat the oven to 400°F (200°C). Line a baking sheet with foil and lightly coat it with cooking spray.
Cut each washed, dried potato lengthwise into 1/4-inch slices, then cut each slice into 1/4-inch fries.
Place the cut potatoes in a large mixing bowl and drizzle with 2 tsp olive oil; toss to coat evenly.
Add herbs de Provence, oregano, smoked paprika, chili powder, onion powder, garlic powder, and fresh cracked pepper to the bowl; toss until the fries are evenly seasoned.
Arrange the seasoned fries in a single layer on the prepared baking sheet, leaving space so they can crisp up.
Bake uncovered for about 25 minutes, turning once halfway through, until the fries are tender with crisp edges.
While the fries bake, make the skinny garlic aioli by combining light mayonnaise, fat-free Greek yogurt, crushed garlic, and fresh lime zest in a small bowl; mix until smooth.
Remove fries from the oven and serve hot with the garlic aioli.