Miss. Code § 27-71-305
The specific privilege taxes imposed in Section 27-71-303 shall be paid to the commissioner before beginning the business upon which the tax is imposed.
Any person liable for the payment of any such privilege tax, who shall fail to pay the same and procure a license therefor before beginning the business for which such privilege tax is required, or who shall fail to renew, on or before the expiration date, the license on a business for which he has theretofore procured a privilege license, shall be liable for fifty percent (50%) of the amount of the tax imposed in Section 27-71-303 as penalty for the privilege of engaging in such business; and such tax and penalty shall be collected by the commissioner before a privilege license is issued.
Miss. Code § 27-71-305