I worked at the University of California Berkeley and the University of Washington and both had a nuclear reactor like you describe. Both have been decommissioned and the Nuclear Engineering departments are shut down. I was in the one at Cal and was able to look down into the reactor pool. Not something I would do again.