Help ! I have nat's in one of my indoor plants> how do I get rid of them ?

the dirt is new in the pot and the plants are new from starters others have given me. but every time I touch the plant or water it .....all these little flying nat's come out.