If you want to totally stop using BPS you then have to revert .htaccess files to WordPress defauls. Deactivating the BPS Plugin has no effect as long as those files still exists.