My big mining rig project
-
[quote name=“ChristianRiesen” post=“4426” timestamp=“1368984090”]
[quote author=pyxis link=topic=387.msg4424#msg4424 date=1368982482]
Its a pity all that ducted heat can’t be reused for something else.
[/quote]
Yes, I agree. Wish There was a heat exchanger so I could feed it into some heat storage which in turn could be used to heat water for daily use.
[/quote]I don’t think it would be possible as the losses you’d incur would be too great. Interesting idea though. I did do some quick reading as I thought how do submarines handle heat generation/storage. Seems they just use the hull as a giant heat sink as they produce far more than they need.
-
That looks amazing. I can’t wait to see some numbers on how well it keeps the cards cool. Nice work.
-
[quote name=“steganos” post=“4804” timestamp=“1369113473”]
That looks amazing. I can’t wait to see some numbers on how well it keeps the cards cool. Nice work.
[/quote]
Thanks. I planed on making extensive tests. As soon as I have the risers I can finish the design and send it to be laser cut. While that happens I can do some open air testing to get good numbers of a before and after state. -
I’m sorry no one has told you this, but:
The Z77A-45 can’t hold 7 cards. It has 7 slots, but can’t do 7 cards. It does 5 maximum without a presence short, and 6 with a short on the middle X16. They’re great motherboards, but 7 is a no-go.
-
[quote name=“Benny” post=“6352” timestamp=“1369489940”]
I’m sorry no one has told you this, but:The Z77A-45 can’t hold 7 cards. It has 7 slots, but can’t do 7 cards. It does 5 maximum without a presence short, and 6 with a short on the middle X16. They’re great motherboards, but 7 is a no-go.
[/quote]Hi Benny, Is there a board that can take 7 cards?
-
I honestly am unsure what boards, if any, can hold 7 cards without BIOS or motherboard conflicts. I am certain they exist, but I really can’t speak as to which boards can do it, and are cost-effective. I’m sure something like the MSI Big Bang series can do it, but its cost-prohibitive.
Really, the best you can do is a 5 or 6 card setup based on the MSI-Z77A-45, or a similar board. If you keep adding GPUs, you’re going to offset the CPU/RAM/ect savings by more money on larger PSUs (assuming you don’t use a dual setup), as well as motherboard costs.
The last time I did a CBA on it, you may save 3-4% of your costs on a 6-card presence shorted Z77A, assuming it works properly.
IMO, going with 4 cards is probably going to be optimal for most scenarios. The more you get, the more PSUs/bigger PSUs, which kill any sort of advantage of more cards per rig. RAM, CPUs, and HDD space are the cheapest parts of a rig, whereas GPU and PSU are the most expensive - which mostly correlate with the higher prices.
FWIW, I have 2 Z77A-45 rigs that have 5 cards each… Probably one of the first people to use the configuration for 5x7950. Its nice, but the power draw is insane. Much easier to simply get a 4x PCIE board (Z77A-41, or a MicroATX) board, save $50, and deploy a 4x setup of WF3s or another GPU that will get you ~2.6 MH on one rig.
-
[quote name=“Benny” post=“6352” timestamp=“1369489940”]
I’m sorry no one has told you this, but:The Z77A-45 can’t hold 7 cards. It has 7 slots, but can’t do 7 cards. It does 5 maximum without a presence short, and 6 with a short on the middle X16. They’re great motherboards, but 7 is a no-go.
[/quote]
Thanks for the input. Can you be a bit more specific? According to everything I can find on the topic, the board has all 7 slots wired and all 7 can be used at the same time (using them all as x1 only). Is there something you can link me to why this shouldn’t work? -
[quote name=“Benny” post=“6370” timestamp=“1369500205”]
I honestly am unsure what boards, if any, can hold 7 cards without BIOS or motherboard conflicts. I am certain they exist, but I really can’t speak as to which boards can do it, and are cost-effective. I’m sure something like the MSI Big Bang series can do it, but its cost-prohibitive.Really, the best you can do is a 5 or 6 card setup based on the MSI-Z77A-45, or a similar board. If you keep adding GPUs, you’re going to offset the CPU/RAM/ect savings by more money on larger PSUs (assuming you don’t use a dual setup), as well as motherboard costs.
The last time I did a CBA on it, you may save 3-4% of your costs on a 6-card presence shorted Z77A, assuming it works properly.
IMO, going with 4 cards is probably going to be optimal for most scenarios. The more you get, the more PSUs/bigger PSUs, which kill any sort of advantage of more cards per rig. RAM, CPUs, and HDD space are the cheapest parts of a rig, whereas GPU and PSU are the most expensive - which mostly correlate with the higher prices.
FWIW, I have 2 Z77A-45 rigs that have 5 cards each… Probably one of the first people to use the configuration for 5x7950. Its nice, but the power draw is insane. Much easier to simply get a 4x PCIE board (Z77A-41, or a MicroATX) board, save $50, and deploy a 4x setup of WF3s or another GPU that will get you ~2.6 MH on one rig.
[/quote]What kind of power supply do you use? I run out of power on the 1200W supply I have with 3 cards already…
-
I only run 4x cards, but use 1250-1300w rated gold/platinum PSUs… Seasonic, Rosewill, ect.
You shouldn’t be pulling 1200w on a 3x7950. You should only be pulling about 900-1000w at maximum.
-
I’m using a 1500watt thermal take psu, pulling 1000watt on 4 X 7950’s no overclocking, with overclocking its pulls just under 1200watt.
-
[quote name=“Benny” post=“6503” timestamp=“1369520909”]
I only run 4x cards, but use 1250-1300w rated gold/platinum PSUs… Seasonic, Rosewill, ect.You shouldn’t be pulling 1200w on a 3x7950. You should only be pulling about 900-1000w at maximum.
[/quote]I’m pulling just about 1000 with 3 cards, but that is on the socket. I haven’t tried with 4 cards on one PSU. From my experimentations, one additional card sucks down roughly 300 W.
-
Was thinking about the drawing you showed me, have you checked that the extension cables are long enough to reach each card (since you will have alot of space between them)
-
Holy canola batman, I just came across this nugget in my research on trying to figure out what my board does (and doesnt) do:
[url=http://www.tomshardware.com/reviews/z77-express-ivy-bridge-benchmark,3254-26.html]http://www.tomshardware.com/reviews/z77-express-ivy-bridge-benchmark,3254-26.html[/url]
[quote]MSI saves one of the Z77’s PCIe 2.0 lanes by omitting the PCIe-to-PCI bridge needed by certain competing boards to support legacy slots, and then uses it on a PCIe-based network controller. Only three PCIe 2.0 lanes remain to feed four x1 slots, so MSI decided to connect both of the center x1 slots to the same pathway. These can’t be used simultaneously. Appearing to be a blatant move to artificially bolster the board’s spec sheet, we think MSI should have simply left off the x1 slot immediately below the top x16 interface. The GPU coolers of most high-performance graphics cards cover that slot anyway.[/quote]
So no wonder I got weird problems as soon as both middle plugs were in.I think I will see if I can get a different board. Really want this build to be able to run 7 cards. Otherwise I have to go down to 6 and that doesn’t sit right with me. I might as well just create 4 card rigs then.
As for the cables, I went with what the people making them told me. Big mistake. The cable are short in any which way you slice it. I will have to change the model some more to compensate. Now that I have the risers to play with, and the second power supply, I can also measure all cables and hands on experience with how flexible the risers are really (hint, not very much…)
My quest continues.
-
[quote name=“Benny” post=“6370” timestamp=“1369500205”]
I honestly am unsure what boards, if any, can hold 7 cards without BIOS or motherboard conflicts. I am certain they exist, but I really can’t speak as to which boards can do it, and are cost-effective. I’m sure something like the MSI Big Bang series can do it, but its cost-prohibitive.Really, the best you can do is a 5 or 6 card setup based on the MSI-Z77A-45, or a similar board. If you keep adding GPUs, you’re going to offset the CPU/RAM/ect savings by more money on larger PSUs (assuming you don’t use a dual setup), as well as motherboard costs.
The last time I did a CBA on it, you may save 3-4% of your costs on a 6-card presence shorted Z77A, assuming it works properly.
IMO, going with 4 cards is probably going to be optimal for most scenarios. The more you get, the more PSUs/bigger PSUs, which kill any sort of advantage of more cards per rig. RAM, CPUs, and HDD space are the cheapest parts of a rig, whereas GPU and PSU are the most expensive - which mostly correlate with the higher prices.
FWIW, I have 2 Z77A-45 rigs that have 5 cards each… Probably one of the first people to use the configuration for 5x7950. Its nice, but the power draw is insane. Much easier to simply get a 4x PCIE board (Z77A-41, or a MicroATX) board, save $50, and deploy a 4x setup of WF3s or another GPU that will get you ~2.6 MH on one rig.
[/quote]Question here… can a Antec High Current Pro HCP-850 handle 5X7950 ? I mean to be used only for the GPUs?
-
[quote]Question here… can a Antec High Current Pro HCP-850 handle 5X7950 ? I mean to be used only for the GPUs[/quote]
7950s run about 200 watts a piece. short answer, NO :P
-
[quote name=“fher98” post=“7263” timestamp=“1369689207”]
[quote author=Benny link=topic=387.msg6370#msg6370 date=1369500205]
I honestly am unsure what boards, if any, can hold 7 cards without BIOS or motherboard conflicts. I am certain they exist, but I really can’t speak as to which boards can do it, and are cost-effective. I’m sure something like the MSI Big Bang series can do it, but its cost-prohibitive.Really, the best you can do is a 5 or 6 card setup based on the MSI-Z77A-45, or a similar board. If you keep adding GPUs, you’re going to offset the CPU/RAM/ect savings by more money on larger PSUs (assuming you don’t use a dual setup), as well as motherboard costs.
The last time I did a CBA on it, you may save 3-4% of your costs on a 6-card presence shorted Z77A, assuming it works properly.
IMO, going with 4 cards is probably going to be optimal for most scenarios. The more you get, the more PSUs/bigger PSUs, which kill any sort of advantage of more cards per rig. RAM, CPUs, and HDD space are the cheapest parts of a rig, whereas GPU and PSU are the most expensive - which mostly correlate with the higher prices.
FWIW, I have 2 Z77A-45 rigs that have 5 cards each… Probably one of the first people to use the configuration for 5x7950. Its nice, but the power draw is insane. Much easier to simply get a 4x PCIE board (Z77A-41, or a MicroATX) board, save $50, and deploy a 4x setup of WF3s or another GPU that will get you ~2.6 MH on one rig.
[/quote]Question here… can a Antec High Current Pro HCP-850 handle 5X7950 ? I mean to be used only for the GPUs?
[/quote]For 5x7950, you want at least 1500w.
-
[quote name=“Benny” post=“7289” timestamp=“1369696637”]
[quote author=fher98 link=topic=387.msg7263#msg7263 date=1369689207]
[quote author=Benny link=topic=387.msg6370#msg6370 date=1369500205]
I honestly am unsure what boards, if any, can hold 7 cards without BIOS or motherboard conflicts. I am certain they exist, but I really can’t speak as to which boards can do it, and are cost-effective. I’m sure something like the MSI Big Bang series can do it, but its cost-prohibitive.Really, the best you can do is a 5 or 6 card setup based on the MSI-Z77A-45, or a similar board. If you keep adding GPUs, you’re going to offset the CPU/RAM/ect savings by more money on larger PSUs (assuming you don’t use a dual setup), as well as motherboard costs.
The last time I did a CBA on it, you may save 3-4% of your costs on a 6-card presence shorted Z77A, assuming it works properly.
IMO, going with 4 cards is probably going to be optimal for most scenarios. The more you get, the more PSUs/bigger PSUs, which kill any sort of advantage of more cards per rig. RAM, CPUs, and HDD space are the cheapest parts of a rig, whereas GPU and PSU are the most expensive - which mostly correlate with the higher prices.
FWIW, I have 2 Z77A-45 rigs that have 5 cards each… Probably one of the first people to use the configuration for 5x7950. Its nice, but the power draw is insane. Much easier to simply get a 4x PCIE board (Z77A-41, or a MicroATX) board, save $50, and deploy a 4x setup of WF3s or another GPU that will get you ~2.6 MH on one rig.
[/quote]Question here… can a Antec High Current Pro HCP-850 handle 5X7950 ? I mean to be used only for the GPUs?
[/quote]For 5x7950, you want at least 1500w.
[/quote]Why? each 7950 consumes 180w MAX.
-
The max draw is officially 200W with some clocking though it goes higher. And then at the socket it draws more, a lot. I get with 3 cards a draw of 1000W on the socket. The power supply still has reserves, but more than 4 cards on a 1200W PSU I wouldn’t risk. Even though the supply says 1200W, not all of that is available on the rails used for the PCIE. Your mileage may vary.
I’m rethinking my project because 7 cards seems to be almost impossible to pull off, because of crappy board support. I could do it but then pay more for the board then a new GPU would cost. So now I redo it as a 4 card rig, so I would build two of these and see how that goes.
-
[quote name=“ChristianRiesen” post=“7398” timestamp=“1369725656”]
The max draw is officially 200W with some clocking though it goes higher. And then at the socket it draws more, a lot. I get with 3 cards a draw of 1000W on the socket. The power supply still has reserves, but more than 4 cards on a 1200W PSU I wouldn’t risk. Even though the supply says 1200W, not all of that is available on the rails used for the PCIE. Your mileage may vary.I’m rethinking my project because 7 cards seems to be almost impossible to pull off, because of crappy board support. I could do it but then pay more for the board then a new GPU would cost. So now I redo it as a 4 card rig, so I would build two of these and see how that goes.
[/quote]Maybe not 7… but 5 maybe? What mobo would handle this many GPUs nicely?
-
[quote name=“ChristianRiesen” post=“7398” timestamp=“1369725656”]
Even though the supply says 1200W, not all of that is available on the rails used for the PCIE. Your mileage may vary.
[/quote]Most half decent supplies will deliver ALL of the stated wattage to the 12v rails that the pcie uses. My seasonic x1250s for instance deliver 1248w to the 12v rail + 150w to the 5v rail (1400w total). It’s also worth noting that the wattage specified is what it can deliver to the components (output wattage) rather than input wattage (at the wall). An 80+ gold psu is around 87-92% efficient so if you loaded it to 100% you’d pull over 1500w at the wall and still be within spec. These supplies have headroom built in too so I wouldn’t be surprised if you could pull 1600w at the wall before the ocp kicks in.
Now for the disclaimers… The CPU also takes it power from the 12v rail as do hdds and cd-roms etc (that’s why I use ssd). The CPU never ramps up for mining though (unless you gpu mine too but that’s a waste of money IMO). Also, as with most things, heat is an issue. Again, most decent supplies are rated at 50degrees ambient but some lesser supplies my only be able to supply the rated power at 30 degrees which is VERY unrealistic.
Just my 2ftc…