A number of House Republicans are in talks to block Rep. Jim Jordan's path to the speakership as the Ohio Republican tries to force a floor vote on Tuesday, according to multiple GOP sources.

One senior Republican House member who is part of the opposition to Jordan told CNN that there he believes there are roughly 40 "no" votes and that he has personally spoken to 20 members who are willing to go to the floor and block Jordan's path if the Ohio Republican forces a roll-call vote on Tuesday.

"The approximately 20 I've talked to know we must be prepared," the member said. "We cannot let the small group dictate to the whole group. They want a minority of the majority to dictate and as a red-blooded American I refuse to be a victim."

But another GOP source familiar with the matter says that Jordan has had positive conversations with members and believes by Tuesday evening he will be elected speaker of the House. The source said it was "likely" the vote would still happen on Tuesday and that Jordan may decide to go to multiple ballots on the floor if necessary.

Republicans are expected to meet behind closed doors Monday evening.

Yet there is still sizable opposition to Jordan. The GOP member says there are some Republicans who are critics of Jordan and not willing to back him -- and there are others angry at the hardliners who took out Kevin McCarthy and sunk Steve Scalise and don't want to reward those moves by electing Jordan, who is their preferred candidate.

"I know of many hard nos. ...We can't reward this behavior," the GOP lawmaker said. "We can't let a small group be dictators."