Complex dynamics and multistability in nonlinear resonant nanosystems beyond the duffing critical amplitude