No one has ever been ousted from the EU. Several of the Maastricht criteria only apply to countries that have not yet joined the common currency. For example, inflation, exchange rate stability, and long term interest rates are the responsibility of the EU central bank after convergence. In 2014, fifteen of twenty-seven countries missed the criterion for debt as a percentage of GDP:
While people have discussed the possibility of Greece or the UK leaving, I've never heard anyone argue that Germany or France should be kicked out. The UK discussion that I have seen has been about the UK leaving voluntarily. Both sides have discussed the possibility of Greece leaving.
The Stability and Growth Pact is supposed to regulate compliance with the fiscal criteria, but the non-compliance of Germany and France has led to it being imperfectly applied. It is supposed to invoke penalties in the case of non-compliance but hasn't in many cases and was explicitly weakened in 2005.