I used ChatGPT to translate image text when Google’s tool failed me – and things got weird

Must Read
bicycledays
bicycledayshttp://trendster.net
Please note: Most, if not all, of the articles published at this website were completed by Chat GPT (chat.openai.com) and/or copied and possibly remixed from other websites or Feedzy or WPeMatico or RSS Aggregrator or WP RSS Aggregrator. No copyright infringement is intended. If there are any copyright issues, please contact: bicycledays@yahoo.com.

One of many enjoyable points of my roles as technical columnist and YouTube producer is testing new devices as they arrive out. I have been testing an Anycubic Kobra 3 3D printer for some time now, which led to this text.

3D printers use software program known as a slicer, which converts a 3D mannequin into layers that the 3D printer lays down in molten plastic. An unlucky new pattern is that many of the greater 3D printer firms have taken an open-source slicer known as Orca Slicer and rebranded it for their very own use, including machine-specific code to allow printing with their printers.

Anycubic did this with their Anycubic Slicer Subsequent, which considerably improved their earlier home-grown slicer. Anycubic relies in China. Whereas many of the screens for his or her slicer have been translated into English, the standing web page nonetheless stays in Chinese language. I am certain they will replace it quickly, however I am testing the brand new launch now.

Whereas many of the standing display screen is self-explanatory primarily based on context, there have been two areas the place I actually wished to grasp the textual content. At (1) there are two buttons. I did not wish to flip the buttons till I knew what they meant. And there was a giant pink discover at (2). Is that this an vital warning I would like to concentrate to?

Google Translate

Sometimes, after I want one thing translated, I simply drop it into Google translate. However I’ve at all times used Google Translate for pasting in textual content. On this case, I could not paste within the textual content, so I clicked the Photos choice and acquired an add display screen.

I then uploaded the screenshot I confirmed you above (the unique did not have the inexperienced numbers), and fed it to Google.

I acquired again the next display screen.

As you may see, Google Translate changed many of the Chinese language textual content with English textual content. I might inform that the 2 switches management the print head gentle and the digicam gentle, respectively.

Sadly, the pink warning textual content was fully unreadable, even after zooming in at 700%.

That was a bummer, so I made a decision to attempt ChatGPT Plus. The outcomes had been decidedly combined.

ChatGPT Plus textual content output

I used the little plus button in ChatGPT Plus and fed it my screenshot. Nearly instantly, I acquired again a web page describing every Chinese language string and its English counterpart.

I seen two issues. First, at (1), ChatGPT knowledgeable me {that a} firmware replace was required. Google Translate had ignored the blue textual content on the unique and hadn’t offered that block of textual content in any respect in its re-rendered screenshot.

Second, at (2), ChatGPT did, the truth is, translate the pink warning message. Mainly, it mentioned that for those who transfer the print head round on the machine by hand, you must watch what you are doing. It is a useful suggestion, however the pink block of textual content I would fearful about for months wasn’t something I wanted to fret about.

After which, on the backside, ChatGPT supplied to overlay the English translation on the unique screenshot. This I needed to see.

ChatGPT Plus loses the thread

ChatGPT had already completed what I wanted from it, so the remainder of this was merely curiosity in my function as an AI investigator. I responded to ChatGPT’s invitation by prompting it with, “Sure, please overlay the annotations on the screenshot visually.”

I acquired again this.

As you may see, ChatGPT very thoughtfully positioned overlays on the unique screenshot. It simply did so utilizing blue Chinese language lettering as a substitute of offering English translations. Some, like within the high center of the display screen (at 1), had been much like the Chinese language characters already there. Some, like within the decrease proper of the display screen (at 2) the place that pink warning message had been, positioned blue Chinese language letters with far fewer symbols than the unique textual content.

Curiously, ChatGPT additionally redid the picture. The English textual content (at 3) that had initially learn “Body1_PLA_0.2_52m49s.gcode” was modified to “Baby_PLA3_FullNoo.gcode”. The 4 spools of filament had been changed by three spools (at 4) and had been recolored (at 5).

Ever the optimist, I made a decision to provide ChatGPT one other probability. I prompted it with “Please attempt that once more, overlaying English translations to the Chinese language lettering.”

And, nicely, I acquired one thing again.

This one confirmed all 4 filament spools, so there’s that. It did change the Chinese language characters with English phrases, however it ignored the pink immediate I used to be interested by, in addition to the firmware replace discover.

However what I wish to level your consideration to is the digicam view. If you happen to evaluate intently to the unique, you may notice that ChatGPT redid the precise photograph. The photograph, because it seems, did not have something needing to be translated. The picture on the left is the unique. The picture on the fitting is ChatGPT’s reinterpretation.

Let’s run down the checklist of what ChatGPT modified:

  • Inexperienced arrow: The Kobra 3 gadget identify, which was in a stencil-like font with slash shapes, was changed with simply the phrase Kobra.
  • Orange arrow: By no means clear what ChatGPT determined to do to my plug array.
  • Cyan arrow: The print head, which is a dice, has develop into a flat object on the brand new picture.
  • Yellow arrow: The thing being printed modified form significantly, from an merchandise with tree helps to one thing that appears like a golden pedestal.
  • Purple arrow: “Sided PEI Sheet” was “Serial PEI Shoot.”
  • Purple arrows: The labels had been moved and adjusted.
  • Magenta arrow: The stuff throughout the room and the door had been modified.

So, yeah. That occurred.

AI giveth and AI loseth its thoughts

On one hand, lets say that ChatGPT did give me what I wished, which was the interpretation of the pink warning discover and what these buttons did, the place Google made it inconceivable to see the warning discover textual content. In that context, ChatGPT received and Google misplaced.

However was it a fluke that ChatGPT gave me a text-only translation first? As a result of if ChatGPT had given me just one or the opposite of the screenshots it gave me, we might should say Google received, not as a result of Google gave me what I wished, however as a result of ChatGPT misplaced its furry little thoughts.

There’s a lot about generative AI that is actually cool. However every now and then, we additionally get some critical head scratchers. I did get my reply, however I additionally acquired to look inside a really disordered AI mind.

This can be a enjoyable job.

Have you ever tried utilizing AI instruments like ChatGPT or Google Translate to decipher textual content in pictures? What labored finest for you? Have you ever encountered any unusual or sudden outcomes like those described right here? What’s your go-to instrument for translating or analyzing interface parts in different languages? Tell us within the feedback under.


You possibly can comply with my day-to-day undertaking updates on social media. Remember to subscribe to my weekly replace publication, and comply with me on Twitter/X at @DavidGewirtz, on Fb at Fb.com/DavidGewirtz, on Instagram at Instagram.com/DavidGewirtz, on Bluesky at @DavidGewirtz.com, and on YouTube at YouTube.com/DavidGewirtzTV.

Need extra tales about AI? Join Innovation, our weekly publication.

Latest Articles

Windsurf slashes prices as competition with Cursor heats up

AI coding assistant startup Windsurf reduce its costs “throughout the board” it introduced on Monday, touting “large financial savings”...

More Articles Like This