AIの進化が止まらない→スクショを送るだけでゲームも作れる、バグも修正できる、宿題もやってくれる、認証システムも…… 【GPT-4V 使用例】

OpenAIが提供するChatGPT Visionは画像の認識や分析に長けた機能 (要:$20/月のChatGPT Plusアカウント) 例えば、バグが起こっている様子をスクショして送れば、AIがソースコードの問題箇所を検出し、訂正したコードを送ってくれます。 ほかには手書きの文字を読み込んでテキストデータにしたり、画像を認識してその状況を文章化したりといった使い方も可能です。 生成AIの発展によって現在プロンプトエンジニアリングは注目を集めていますが、この技術を上手く活用できればプロンプトを書く手間すらも減らしていけるかもしれません。
49
Barnacules Nerdgasm @Barnacules

Ex-Microsoft Level 65 Senior Software Developer 👨‍💻 Shipped Windows XP through Windows 10 🪟 Creator of Barnacules Nerdgasm™️ on YouTube & Twitch 🎦 Hello! 👋

linktr.ee/barnacules

Barnacules Nerdgasm ™️ @Barnacules

I just got ChatGPT to write me an entire Tetris clone with animated 3D starfield in the background with scoring mechanics and sudo 3D effect on blocks. I want to make it clear I didn't write a single piece of code, only copied and pasted after telling it to add each feature! 😎 pic.twitter.com/hnoaN5uiwV

2023-10-17 11:07:36
拡大
拡大
Barnacules Nerdgasm ™️ @Barnacules

Now I have a preview of the next piece coming up in the upper right corner so you can plan your strategy and the game speeds up every 50 points 😲 Anyone could do this without knowing how to code just by cutting and pasting stuff into notepad and running it 🤣 Tetris might be simple but not even I could have coded it this fast.

2023-10-17 11:28:45
拡大
Barnacules Nerdgasm ™️ @Barnacules

This is just mind blowing 😲 I watched @davepl1968 video where he solved a problem by sending a screen shot of the output from code to ChatGPT and it helped him solve his problem. I just did the same thing with my GPT4 programmed Tetris Clone and it figured out the issue 🤩 #AI pic.twitter.com/iq8BtMTidM

2023-10-17 12:34:13
拡大
jeffrey r wright @JRansomWright

@Barnacules @davepl1968 Does it dissolve layers as they fill in? Can you take a short video of the game play?

2023-10-17 12:46:18
Barnacules Nerdgasm ™️ @Barnacules

@JRansomWright @davepl1968 I just quoted your post and included a video of the game play so far so you can see where it's at. Keep in mind that it fixed several bugs by me just taking a screen shot and send it to it and asking it to figure out what is wrong with the code and it did and sent me a fix.

2023-10-17 13:15:19
jeffrey r wright @JRansomWright

@Barnacules @davepl1968 That’s the part that is completely amazing with AI, you were able to send a screenshot, not a part of code, an image, to the engine, and it was able to solve the problem. This is the future.

2023-10-17 13:29:24
Barnacules Nerdgasm ™️ @Barnacules

This is just wild; I have no clue how the hell this is even possible 🤷‍♂️ Just by me giving it a screen shot it was able to determine exactly where the problem was in the source code & devise a functioning solution 🤩 I'm just blown away by this quite frankly 🤯 I'm at a loss...

2023-10-17 12:34:14
Barnacules Nerdgasm ™️ @Barnacules

This is the current game play footage from the Tetris clone @OpenAI ChatGPT 4 programmed for me from scratch just by asking for features one-by-one 🤯 When I encountered a bug, I sent it a screen shot & it was able to resolve the issue & give me fixed code! 😲 #GPT4 #Vision #AI twitter.com/JRansomWright/… pic.twitter.com/LjLcbOKhli

2023-10-17 13:14:19
Barnacules Nerdgasm ™️ @Barnacules

You know you want to play my new Tetris game developed from scratch by simply asking questions to ChatGPT 4 and doing some cut/paste and screenshots to debug & tune 😎 The end result is amazing given the time it took me and the code layout is clean too 👍 github.com/Barnacules/GPT… twitter.com/Barnacules/sta… pic.twitter.com/hiZe3RjFnI

2023-10-17 20:02:12
Barnacules Nerdgasm ™️ @Barnacules

Introducing GPT4Tetris v1.0 100% programmed via a conversation in English with @openai ChatGPT 4 🤯 Only thing I did was describe what I wanted, describe the issues with each generation & copy/paste the changes 😎 English is now a programming language 🤩 github.com/Barnacules/GPT…

2023-10-17 14:49:37
Barnacules Nerdgasm ™️ @Barnacules

@melovescotch @OpenAI I tried copilot and didn't like it, the way it would write code in the compiler was really unstable and half the time it wouldn't even be intended properly or function. I find it much more pleasant to just start a conversation with ChatGPT 4 and copy and paste what I need.

2023-10-17 13:32:26
Acemods101 @acemods101

@Barnacules Ai is certainly getting better and better

2023-10-17 20:15:41
Chris Fraser @defrisselle

@Barnacules @OpenAI Would Galaga or Centipede be too complex Maybe a Pac-man clone

2023-10-17 13:59:03

Visionを使えばこんなこともできる

Peter Kowalczyk 🍍 @peter_kow

ChatGPT Vision - from a screenshot of any website. 😱 Example for Google Search with direct updates by asking GPT-4V for more updates. This is mind-blowing and scary😱 From now on, you can build a website by giving screenshots and asking for more updates 👇🏻 pic.twitter.com/ygWAZy9Um5

2023-10-03 03:21:39
Arthur 𝕏 @ArthurFromX

@OpenAI ChatGPT-4 + Vision is mind blowing! I created a working iPhone game app from a simple hand drawn sketch in a matter of minutes. I’ll detail how I did this in the thread below pic.twitter.com/w1Tace7EOk

2023-10-05 02:42:18
拡大
Florian Camiade 🗝️ @FCamiade

Does ChatGPT Vision mean the end of homework? With this feature, you can solve complex problems. Students will love it... It's very powerful in math, physics or chemistry. You'll get the answer, and an explanation if you need it: 1. Put an image of your course in ChatGPT 2. Add your prompt Prompt in this example: "This is an advanced physics problem. Please solve as many points as you can and explain each step." Once again, the education system will have to adapt. Teachers already knew that... By the way, maybe ChatGPT Vision can help them correct more quickly? I'll be doing more use cases soon. Follow me to see more!

2023-10-14 18:28:42
Jonathan Slotkin, MD @slotkinjr

@natfriedman @goldbergcarey ChatGPT Vision did a nice job. Of course the purple boxes helped it. pic.twitter.com/J2E728SyJg

2023-10-13 03:13:34
拡大
拡大
Hanrui Wang @hanrui_w

Pretty strong OCR capability of gpt-4v, much easier to read age-old documents #chatgpt #GPT4V #GPT4 #GPT pic.twitter.com/USm9SZT1gm

2023-10-15 10:59:04
拡大
Manny Bernabe @MannyBernabe

ChatGPT-Vision can do insurance damage reports. Example 1 pic.twitter.com/NilFPfSJIZ

2023-10-06 11:23:26
拡大
拡大
Alvaro Cintas @dr_cintas

ChatGPT with Vision keeps impressing me more and more! I wanted to see if it could code the game Wordle by just providing one image for the instructions and one for the gameplay. It essentially code me the entire game in minutes. pic.twitter.com/Gzr6H6gRCY

2023-10-17 03:41:23
Haider. @slow_developer

With GPT-4 vision, you can do anything. It just coded this game based on the picture. 🤯 Here is the process I followed: pic.twitter.com/2FcP96LErA

2023-10-16 19:51:22
Mr. Slothuus @UlrichSlothuus

#GPT4V is a fantastic tool. I can't code, but I created a Snake game on the first try🤯🤖 Welcome to the future👍 #ChatGPT #GPT4 #AI #aitools #snakegame @OpenAI #AIart #FutureOfWork pic.twitter.com/pTwFhhpnzp

2023-10-15 17:54:48
拡大