When Devise sign_in, sign_up does not work with RSpec request spec

I was updating a Rails 6 project, there were som technical debt, I needed to remove or make failing tests pass. When I was trying to fix request spect, I found out that sign_in and sign_up devise helpers did not work.