Yes, a Tashlumin is necessary at Maariv.
If it is Rosh Chodesh, the Tashlumin of course will be with Ya'aleh V'Yavo.
If it is no longer Rosh Chodesh at Ma'ariv, it is a machlokes HaPoskim.
Some Poskim say that if you daven your Tashlumin without Ya'aleh V'Yavo, then you defeated your purpose, so there is no point of davening again, as you are missing a Ya'aleh V'yavo from Mincha, and you are still missing it after the Tashlumin.
Others say that by missing Ya'aleh V'yavo in your Mincha Shemona Esrei, you were not Yotzei your Shemona Esrei at all, so the Tashlumin is necessary for your Shemona Esrei and not just for the Ya'aleh V'Yavo, so of course by doing a Tashlumin, you make up for a missing Shemona Esrei.
So, what should be done?
The Poskim say that the best thing to do is to indeed daven two Shemona Esrei by Ma'ariv, and a T'nai (stipulation) should be made before starting the second Shemona Esrei, as follows:
"If I am obligated in this Tefilah, it should satisfy my obligation. If I am not obligated in this Shemona Esrei, let it be considered a Tefilas Nedava (not a mandatory Tefilah, similar to a Korban Nedava which was not obligatory)"
If Ya'aleh V'Yavo was mistakenly recited in the Shemona Esrei of Tashlumin, when it was no longer Rosh Chodesh, it isn't considered a Hefsek.
If this happens when Rosh Chodesh is on Friday, it will not work, as we may not daven Tefilas Nedava on Shabbos. (If it does happen on Friday night, either have Kavana when the Chazan says the Bracha of M'Ein Sheva, or even better, daven for the Amud, if possible, and by saying the M'Ein Sheva it will be your Tashlumin)
The above applies every time one has a real safek if he is obligated in davening a Shemona Esrei, that it be done with this stipulation.
(See Mishna Berura Siman 108: 32-35, and Biur Halacha Siman 108:12 Dibur Hamaschil HaToeh)