If i work in NYC and my wife works in NJ, for submitting IT-2104 what should be the total number of allowances i need to claim for NY state and NYC - no dependents

It depends.   Calculate the number of withholding allowances you want to claim in Part 1 and Part 4 of the worksheet.  If you want more tax withheld, you may claim fewer allowances.   The worksheet is linked above and the full instructions for the form are attached here.  Entering zero allowances will result in your employer withholding the maximum amount, which may be the correct option.   Allowances will reduce the amounts withheld.    

If you submit a federal Form W-4 to your employer for tax year 2020 or later, and do not file New York State Form IT-2104, your employer may use zero as your number of allowances. For tax years 2020 or later, withholding allowances are no longer reported on federal Form W-4. This may result in the wrong amount of tax withheld for New York State, New York City, and Yonkers.