Slice the bacon and fry the bacon bits in a Dutch oven or heavy bottom stock pot until crispy. Remove with a slotted spoon. Remove most of the bacon grease until only 3 tablespoons remain.
While the bacon is frying, chop up the onion, celery stalks, and garlic. Cut the potatoes into cubes.
Add the onion to the greased pot and sauté until translucent, 3 to 4 minutes. Add the celery and stir until softened. Add the garlic and fry until aromatic, about 1 minute. Toss in the flour and stir to coat.
Add the potatoes and enough stock to cover all the vegetables. Bring the soup to a simmer (just before it begins to boil), then reduce heat to medium-low. Cook until potatoes are soft and cooked through, about 10 to 15 minutes.
Stir in the seasonings, sour cream, cheese, and reserved bacon. Cook for another few minutes until well combined. Serve.