Yes, if you set a public video to private, it will indeed impact the total view count of your channel. When a video is made private, its views are not counted towards the channel's total views. This is because YouTube's policy only counts views from public videos.