Unfortunately not a queen, but her colony is likely nearby! You should keep an eye out. A few Formica species should be flying very soon in your area.
For help identifying a queen, here's a comparison:
This is a typical Formica queen (colors and size may vary!)
Here is a typical Formica worker (again, colors and size may vary between species)...
Notice the size of the mesosoma (the middle part) of the queen compared to that of the worker; the queen has a much larger mesosoma to accomodate her wing muscles. Speaking of wings, make sure to check the mesosoma for wing scars, the scars left over from where the queen tore her wings off. If you find a suspected queen that does have wings, make sure to distinguish her from a male; you can do this by looking at the head. Male heads are much smaller than female heads, and males are normally smaller. And, of course, queens will be much larger than their workers.
Here are a few helpful videos:
Hope you found this helpful!