Should be smooth. Are the boards square or eased (is that the right word, where they're beveled at the top edges a little)? Eased boards are made for uneven subfloors that can't be corrected. If the boards are square, they finished them wrong. It should be flat and smooth.
