When they first saw Him, the Tattvavādī Vaiṣṇavas considered Śrī Caitanya Mahāprabhu a Māyāvādī sannyāsī. Therefore they did not talk to Him.