1. Attachments are working again! Check out this thread for more details and to report any other bugs.

NHW11 Traction battery autopsy

Discussion in 'Generation 1 Prius Discussion' started by oldnoah, Aug 29, 2010.

  1. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,134
    15,393
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    I'm struck by the irony of two safety hazards, one well known and the other known to those who deal with these batteries. The lethal, series voltage has been well known although the relatively easy mitigation, remove the buss bars from one side, not being as well known. In contrast, those who handle these modules are aware of the KOH electrolyte and its ability to dissolve just about everything that it comes in contact.

    The KOH mitigation of boric acid both to neutralize and work as an eye wash is something I don't remember seeing discussed before. But it is such a simple and sophisticated safety feature. Heck, I use dry boric acid to handle insect pests. But neutralizing KOH does not eliminate the conductive path.

    Acids will neutralize KOH and make a salt, a conductive salt. With the pH neutralized, the organic and metal eating characteristics are significantly reduced but the salt trail remains. It may not be as aggressive in 'seeking a current path' but it remains a leakage current path. Now that the original battery modules are in a storage mode, I'm curious about the operational battery that reported the P3009.

    The ScanGauge can be programmed to report the traction battery codes but unless I missed it, I don't think it can reset the codes. So repeating P3009s would be difficult to observe unless the 12 V. ground is removed long enough to reset the ECUs and wipe out the codes.

    The ScanGauge can be programmed to read out the 19 voltage pairs. Knowing how leakage leads to unbalanced modules, it becomes possible to interpret module voltages and manage the existing P3009.

    Speculation on my part, if you decide to refurbish or rework the P3009 traction battery, it makes sense to start or restart a fresh thread. Perhaps starting with the last P3009 code, a reset, and survey of the 19 module pair voltages. Then see if if the P3009 is coming back and the 19 module pair voltages are changing over time. With the insights gained from reading the traction base corrosion, we have another tell for where there are electrolyte leaks.

    Bob Wilson
     
  2. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    At this point the battery with the p3009 is in the car, and driving daily. There have been no codes in about a month. VHi and Vlo are usually 0.2 volts apart. State of charge usually around 60-64. Block 5,7, and 10 are the most frequent readings from bLo, blocks 1 and 19 are the only readings from bHi. I haven't programmed in each of the individual block readings.

    I'm still planning on taking it out and running charge cycles on these 5 module pairs. I will need to know whether the best modules I have from the other battery fall between the specs of the best and worst modules, otherwise there's no point to swapping them out.

    But I'm hesitant to take it out right now, because I need the car, and it seems to be working pretty well for the time being.

    At the very least I have a few more things I want to do with the old battery, not the least of which is getting the electrolyte cleaned off, and cleaning the crap off the buss bar holders. I also want to see how the voltages drift apart when the parallel buss connections are removed. Last night I began a charge at 200mA, Voltage climbed from 7.77 to 8.02 volts (On the fluke. The MRC showed 7.69 to 7.96). Just now I lowered the charge to 100mA, I'd like to see it stabilize at a particular voltage and stop rising, but I don't know what the MRC is going to make of a battery that has this capacity, and in which individual cell characteristics are masked by the parallel connections.

    I want to give it a couple of days like this, then remove the parallel buss connections, measure the voltages at each module, then let it set and take measurements daily until I see what drift occurs.

    Maybe next weekend I'll take the other battery out.
     
    2 people like this.
  3. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    Ok, at 100mA the voltage on the parallel battery pack stabilized at 8.02 volts. I let it sit like that for a day, and then took off the charger. The next day I removed the buss bars. Attached is the spreadsheet detailing the voltages as they settled into their own over the next 8 days.

    BIG CAVEAT: Module 11 did not jump up to 8 volts on its own. I was curious to see how a module that had initially been at 5 volts could decide to settle out at the same voltage as a good module (compare initial voltage with voltage after discharge/charge cycles) after being discharged and charged. Module 8, Module 11 and Module 29 all did this. So after balancing the voltage of all these modules in the parallel stack, I let it settle for a couple of days, and then did a discharge/charge cycle on Module 11. 3 Cycles went by very fast, with very little charge in either directions, and when the cycle was done it read about 6 volts. I assumed that was the end of it. What shocked me was that later in the same day, the voltage had shot up to 8.13 with no additional charge. That voltage remains high, while module 8 and 29 have settled to dramatically lower voltages. I can only assume that module 11 would have degraded similarly with the same time. In any case I'm sure all these modules are junk, but I kept the data anyway.

    I do think my initial assumption that the modules with an initial voltage in the mid 7 volt range were still pretty good, while the ones with ~6 or 5 volts were junk to start with. I could have saved some time by ignoring them, but I guess it was worth the experience.

    I have since disassembled the stack, and started cleaning the modules. First step is dunking them in a vinegar bath, and looking for bubbles. So far I have only done this on junk (6V) modules. I believe I was misled by the drips down the side of the case. All these drips do not appear to have any electrolyte on them, or at least, it's such a thin layer that no bubbles have a chance to form.

    The largest streams of bubbles tend to come from the absorbent pad that is located under the positive terminals. The purpose of these pads seems to be to collect electrolyte before it drips down the case. It's my opinion that the sealant that was added drips down the preferential path from the terminal, and displaces the electrolyte so it misses the absorbent. These seem to be the modules with bubbles streaming from lower on the case, or at least along the corners where the absorbent isn't.

    The second largest streams of bubbles come from the copper corrosion spots, but these only last a short time before they are apparently neutralized.

    The longest lasting streams of bubbles come from the interface between the terminal post and the plastic case. This worries me, because I'm afraid that vinegar might be getting into the case in the same way the electrolyte is getting out. Thus the vinegar could get inside of a good module and neutralize electrolyte within the cells near the terminals.

    The good sign is that some of these modules didn't show any bubbles at all, so maybe they aren't leaking at all. I wish I could record some data or take photographs as I'm doing this, but working with rubber gloves on and covered with vinegar makes that difficult. Least wise I'm not interested in getting this crap on my camera.
     

    Attached Files:

    1 person likes this.
  4. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,134
    15,393
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    Great data!

    Looking at the discharge capacity, my eyes see three groups:
    • recoverable 7, 1, 9, 4, 36, 14, 34, 15, 6, 26, 37, 28, 25, 2, 33, 3, 23 - these look to be recoverable by adding water to replace the lost H{2} and O{2}. There is some minor electrolysis of water over time and if the seals work, the gas remains in the modules and eventually recombines, metal hydride catalyst, to water. But weak seals allow the gas to escape the modules.
    • chemistry change 18, 17, 19, 27 - this looks like a transition in module chemistry. Perhaps some of the rare earths are going into solution and changing the metal hydride.
    • dead or dying 20, 8, 29, 11 - I've seen the curious, 8V behavior in the last module I tried to rehydrate. I could not figure it out but suspect a different chemistry is involved.
    I have more confidence in the discharge capacity than charge capacity. Your data also shows the weaker association of voltage to module capacity and health.

    Although rehydration works, the leaky terminal seals has me stuck. The original H{2} and O{2} leaked out via these seals. Without some way to make the seals more effective, the rehydrated modules will lose their water too. But I'm thinking something that moderates the internal pressure would be a better answer. Reducing the mechanical stress on these weak seals might be the answer. Sealing the modules remains a problem.

    For the rehydration ports, I tested JB Weld but am not sure it is the best answer. I notice someone else is using a rehydrated pack in operation but I think they are using stainless steel, sheet metal screws (an interesting approach.) The Toyota patent discusses plastic welding.

    I was confused about the bubbles from the acetic acid until I remembered Doug reporting that KOH combines with CO{2} to become potassium carbonate. When the acetic acid reacts to become potassium acetate it releases this trapped CO{2}. KOH and acetic acid should not release any bubbles.

    I really appreciate this data. When I was doing my initial studies, I was too focused on individual modules and didn't properly survey the whole pack. Great job!

    Bob Wilson
     
  5. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    Bob,

    Bear in mind that my intention with these modules is to pick a few modules that are close to the state of charge of the other battery, and replacing the modules that are leaking to make a functional battery. I have no intention of trying to get water into them. If the best modules here are inadequate to use at all, I'm wasting my time.

    I have no basis for comparison, and the other battery seems to be working fine right now. Also, I'm very leery of taking the other battery apart, based on some things that have been said here.

    As I understand it, not only is it important to build a battery out of modules with similar characteristics, but it's also necessary that they be similarly charged. So if I take the other battery apart, and do a discharge/charge cycle on those modules, I might wind up over or undercharging them, or charging them the unevenly, which will make the battery that currently works unusable.

    I also can't afford to be without a car for several weeks.

    Then there's the possibility that after cycling all the other modules, I find that they are ALL better than the ones I've tested so far, which leaves me with washing the electrolyte off and putting it all back together as it was, except that I may not be able to match the charges properly.

    I'm wondering if it's possible to do a charge cycle on the parallel stack. But even if the MRC can handle it, I would have no idea whether each module took the same amount of charge.

    And then there's the issue of getting them to be less than 80% charged.

    I'm really looking for feedback here. Any help or suggestions, I'd appreciate it.
     
  6. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    Also, if you want any of the bad modules, you're welcome to them. Once I'm done with the whole project, you're probably welcome to any leftover modules, as I don't expect them to keep until the battery fails again. I think I'll keep the ECU and related parts though, unless reinvolt or somebody wants to pay me something for them.
     
  7. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,134
    15,393
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    Owch, this is a hard problem and I sometimes forget why we went to the swamp. How to evaluate the capacity of a module-pair in an operational traction battery. So with the ScanGauge, we can measure operational:

    • traction battery SOC
    • 19 pair voltages
    • 19 pair internal resistance
    First, take the ones on the bench, top group and put them back in a parallel, trickle mode or pair them in series and then parallel all pairs. Note, I am not sure if it makes more sense to pair strong-to-strong, or strong-to-weak in the pairing but I'm leaning towards strong-to-weak pairing so all series pairs will have similar, dV behavior during charge and discharge. I am sure that absence of charge or allowing self-discharge is death so they need to be kept 'alive.' As for the fubar or marginal modules, time to let them go towards the recycler (any Batteries Plus should be able to handle them.) The bench pairs of modules, in series are building the replacement, module pairs for the weaker pairs that are in the operational traction battery. Now the hard part:

    • measure replacement pairs - internal resistances
    • put pairs in parallel to sustain trickle charge
    So the challenge is to find someway to measure module-pair capacity in the operational pack. Speculations:

    • Measure SOC and 19 module pair voltages - using ScanGauge
    • Force charge traction battery, needs to be done to a cold battery because of heat generated, target 75-80%
    • Measure SOC and 19 module pair voltages
    • Put in "R" with wheels blocked and discharge traction battery to bring SOC down, target 45-50%
    • Measure SOC and 19 module pair voltages
    The slope of these 19 module pairs should identify the weakest and strongest pairs. The goal is to replace the weakest as well as remove any electrolyte leakage paths. Identify the weakest pairs.

    Speculation, during replacement activity:

    1. have new buss bar assembly ready to go (I understand Re-InVolt uses nickel plated ones.) Anything that can be done outside of the vehicle down-time should be done and buss bars are relatively easy.
    2. have replacement module-pairs charged to 80% or better . . . they will be balance charged during the down-time.
    3. remove operational pack and mark the module pairs
    4. removed the buss bars and replace the marginal pairs
    5. remove any electrolyte paths, use vinegar to detect
    6. install one side of buss bars (so there will be 19 series pairs)
    7. wire the 19 pairs in parallel to equalize the charge voltage, give it an hour or so. You may want to use low ohm, ~2-10 ohm, current limiting resistors for the initial connection, a jumper, and then connect the parallel buss. Wait an hour or so for everything to settle.
    8. install the last buss bars
    9. re-install the traction battery
    I agree. A P3009 is not good but if it doesn't come back, lets monitor it for now while keeping the replacement pairs in ready reserve. When module-pair voltages begin to exceed 0.3 V, repairs will soon be necessary.

    Which is why I'm suggesting watch and see if the P3009 returns or a more severe error.
    The key is making sure the pairs are at equal voltage and as well matched in capacity as possible. I'm thinking take the car down on day 1 and swap the module pairs by evening. Leave the 19 pairs in parallel over night with a trickle charge. On day 2, install the last buss bar, close it up, and reinstall.
    There are not many who understand the risks. The first step to mitigation.
    This one is solved by setting the mAhr limit on the MRC. It will only charge to ~112% of the set value. But you've already noticed the MRC is not terribly fast.

    One option might be to get another bad, NHW11 pack and see if enough modules can be found to rebuild the bench pack. Then when it is a good as possible, swap the packs. But this will leave a lot more material left over.

    Given the weakest, module pairs appear to show up in the middle, it may make sense to re-order the 19 module pairs so the strongest are in the middle and weakest on the ends. However, this is getting pretty advanced and assumes we know the relative strengths of each module-pair.

    This is very advanced work, bleeding edge, so be prepared to monitor the pack health over say:

    • 0 day - initial traction battery state
    • 1 week - sanity check
    • 2 week - trend checking
    • 5 week -
    • 10 week -
    • 20 week -
    • annual check - long term
    Bob Wilson
     
  8. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    How does one "force charge" the battery?
     
  9. Patrick Wong

    Patrick Wong DIY Enthusiast

    Joined:
    Mar 8, 2008
    18,199
    6,464
    0
    Location:
    Green Valley, AZ
    Vehicle:
    2015 Prius
    Model:
    Two
    Make the Prius READY, shift to D. Press hard on the brake pedal with your left foot so that the car remains motionless. Floor the accelerator pedal with your right foot.

    Since the car cannot move and hence MG2 is stationary, the power produced by the gasoline engine is routed to MG1 which charges the traction battery. You'll notice that as the traction battery SOC rises, the gasoline engine RPM will decline although the accelerator pedal remains floored. This is because the hybrid vehicle ECU realizes that the battery does not need charging so it tells the engine ECU to slow down the engine regardless of the accelerator pedal position.

    This process may overheat the transaxle so use it at your own risk.
     
  10. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    I should be able to monitor transaxle temperatures with the scangauge. What are reasonable temperatures to expect? And what would be cut off temperatures?
     
  11. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,134
    15,393
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    Patrick pretty well covered it. However, I've not seen a significant transaxle temperature rise when I first tried it (I too was worried so I monitored MG1 and MG2 temperatures in a warmed up Prius.) However, the battery temperature will go up from the exothermic charging, ~9C in my last test:
    [​IMG]
    I also noticed the charging current decreased over time during the forced charge.

    This was part of a late night test where I force charged the Prius and then proceeded to drive in "R" up a hill around seconds 2720-2760. The goal was to get an idea of the Ahr capacity of the traction battery by measuring the power drawn in the reverse drive up the hill. Unfortunately, the hill was too small and a police car came by and started to show some curiosity in the guy backing up a hill at 2:00 AM. So I decided to act as if I'd missed my turn and took a right on to a cross street.

    One of the proposed ways to measure traction battery Ahr capacity is to put a forced charge on it to bring it up to 80%. Then in reverse, drive up a hill and measure how far up before the car stalls, ~40%. The altitude change and mass of the car allows calculation of how much energy it took to reach the 'high point.'

    Legend:

    • Hi C and Lo C - there are four temperature probes and the Graham miniscanner will report the warmest and coldest probes. I don't remember trying to record which probes are where. Read the temperature in C from the left scale
    • Volts (divided by 10) - read on the left scale. First readings, ~295 V. Last reading ~302 V.
    • Traction battery Amps - read on the right scale.
    Bob Wilson
     
    1 person likes this.
  12. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    Bob,

    I get that the green line is amps drawn on or charging the battery. What is the volt measurement, and what is the scale?

    Also, what are Hi C and Lo C
     
  13. Patrick Wong

    Patrick Wong DIY Enthusiast

    Joined:
    Mar 8, 2008
    18,199
    6,464
    0
    Location:
    Green Valley, AZ
    Vehicle:
    2015 Prius
    Model:
    Two
    My guess is that the traction battery voltage measurement is using the left scale x 10. The battery assembly has four temperature sensors, so Hi C and Lo C are probably showing you the highest and lowest readings in degrees Centigrade.
     
  14. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,134
    15,393
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    Patrick is right and I've edited in some details about the test and what I was trying accomplish.

    Bob Wilson
     
  15. jk450

    jk450 New Member

    Joined:
    May 11, 2005
    596
    54
    0
    You won't overheat it by force charging it.
     
  16. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    Is force charging any worse than just regenerative braking? I can certainly see the battery temp rise there, but I haven't been monitoring transaxle temperatures at the same time.

    Today I started programming in all 19 module pair voltages. What a project! Scangauge may be great for being able to get a lot of data that other scanners don't at a reasonable price, but jeez it's about as inconvenient as it can get. Be nice if you could upload and download xgauge sets like putting playlists into an ipod, but I guess that's too much to ask.
     
  17. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,134
    15,393
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    I don't know. However, the earliest traction battery failures seem to be associated with hot climates and hilly areas.

    AMEN!

    The ability to initialize the unit and use the 9V to bring it into the house and plug-in to a wall wart . . . But gosh it is tedious.

    Bob Wilson
     
  18. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    Sorry my question referenced battery temp, but what I was asking was whether force charging is potentially more damaging to the TRANSAXLE than regenerative braking. I was merely pointing out that I have only had the battery temp as a point of reference while driving.

    (I just now programmed in MG1 and MG2)
     
  19. oldnoah

    oldnoah Member

    Joined:
    Aug 21, 2010
    187
    53
    0
    Location:
    New York
    Vehicle:
    2001 Prius
    Model:
    N/A
    While I'm at it, I had noted a statement that if MG1> MG2 this is an indication of a failing transaxle. I was sitting in the car at lunch, programmed in MG1 and MG2, and also tried force charging the battery a little bit just to see how fast the soc went up (I just charged it from 68 to 69).

    Somewhat later I decided to check the transaxle temperatures and found MG1 = 82, and MG2 = 73. Is my transaxle failing? Or is this a function of the force charge?
     
  20. bwilson4web

    bwilson4web BMW i3 and Model 3

    Joined:
    Nov 25, 2005
    27,134
    15,393
    0
    Location:
    Huntsville AL
    Vehicle:
    2018 Tesla Model 3
    Model:
    Prime Plus
    Sorry if I missposted:

    OK: MG1 > MG2 :: MG1 is between the ICE and MG2 and should be close to the ICE coolant temperature.

    BAD: MG2 > MG1 :: MG2 is on the end and is cooled top, bottom, front, rear, and end by air. If MG2 is warmer than MG1, there is a problem or my wife is driving at speeds of +75 mph up and down the hills on I-65 to Nashville.

    Thanks,
    Bob Wilson