To remove this thought of that you are not in smadhi. This is the biggest ignorance you have and onces you remove it. Well congratulations you are in oneness now.
Removing this ignorance is the toughest part to live with oneness.
As I said already you are oneness that's it. Check it out only one time that you are presence simple. After that everything depends upon your ignorance. Ignorance is nothing but thinking that you are not presence or simply still trying to find out presence somewhere. It's like a male trying to find itself as male..... You don't have ignorance in case of male or female body. Then why you have ignorance of presence?
Leave your ignorance that you are not presence simple. Samadhi means you are presence now don't overthink it.