I have written a reviewed piece about field artillery that puts a lot of factoids and basics together in one place. I have attached a copy for you. It has a bibliography that lists a number of the better-known sources. Unfortunately, there's really not a single reference that puts it all together (thus, my attempt with regard to field artillery). Some books are really encyclopedias documenting all the various guns - or projectiles - and their variations but they don't really touch much on things like tactics or logistics. Some are about tactics in general and have a chapter regarding artillery. It really is difficult to get educated about a lot of the details.
While my piece does not address coastal, naval, or heavy artillery (well, not much) if I may say so I think it does serve as a solid introduction to CW field artillery (my goal). And, as I said, it has been reviewed by people better informed and read than me and I'm certain that there are no errors of fact.
That said, here's one you probably can get used for cheap:
Coggins, Jack (1990) Arms and Equipment of the Civil War (Dover Publications, New York).
It's only 160 pages or so but it's pretty action packed and touches on all the the types of artillery you mention to some degree. The author did all the illustrations which are very good drawings. If you read this book you'll have a good, general, understanding of Civil War weaponry, equipment, and a little about tactics. In short, it makes a very good little intro.