When Jesus says depart from me I never knew you was this to former Christians?

The people had done signs and wonders and cast out demons in his name. Surely only a born again Christian has the anointing to cast out demons. Jesus said a kingdom can't be divided against itself? And if these guys were Christians at some stage where they like prosperity teachers who fell away by serving the lusts of the flesh?