【ChatGPT Vision】ついに画像を読み込んでゲームが作れる時代に!生成AIは今後のゲーム開発を変えるのか

OpenAIが提供するChatGPT Visionは画像の認識や分析に長けた機能 (要:$20/月のChatGPT Plusアカウント) 今回はその機能を用いて、ゲームの説明・見た目が記された画像とプロンプトから"Wordle"を作成することに成功 ほかには手書きの文字を読み込んでテキストデータにしたり、画像を認識してその状況を文章化したりといった使い方も可能
20

AIによる画像認識で単語推理ゲームを作ることに成功

Alvaro Cintas @dr_cintas

Educating about AI, Cybersecurity and Technology | Professor & Computer Engineer, PhD | ✍️ @therundownai

Alvaro Cintas @dr_cintas

ChatGPT with Vision keeps impressing me more and more! I wanted to see if it could code the game Wordle by just providing one image for the instructions and one for the gameplay. It essentially code me the entire game in minutes. pic.twitter.com/Gzr6H6gRCY

2023-10-17 03:41:23
Alvaro Cintas @dr_cintas

✍️ NOTES, PROMPT, IMAGES: I tried the same prompts twice since the first time it was giving me issues about me wanting to use a specific library (you certainly don’t have to add that). Also, I used a couple of prompts after since it wasn’t 100% the same at first. Prompt: “You are a software developer. Your task is to program the exact game you see in the picture. I attached the rules and how the game looks. Code it identical. Please think step by step. Also, it might be best if you use the PyQt library.” What should I try to do next? 👀

2023-10-17 03:41:25
拡大
拡大
Alvaro Cintas @dr_cintas

If you enjoyed this post, it would be great if you could like and repost. Also, you can support by Subscribing. I’m planning on posting extra material for my Subscribers :) twitter.com/dr_cintas/stat…

2023-10-17 05:08:10
Alvaro Cintas @dr_cintas

@NorthstarBrain So many things to try! 😅 I'll see if I have time haha

2023-10-18 01:48:28
Alvaro Cintas @dr_cintas

@jackloganjohns Same! But I find it sometimes too easy so I might have to code one with longer words 😅

2023-10-17 03:51:57
Bryan Marley @_bryanmarley

@dr_cintas A brand new use case, unlocked! Nice to see you making the most of Vision. Solid tutorial, hermano! 👌🏾

2023-10-17 10:05:10
Ramesh Dontha 🦉 @EntrepreneursAI

@dr_cintas "That's incredible! The fusion of vision and text understanding in ChatGPT is truly game-changing. Just goes to show the leaps AI is making. Can't wait to see what else it can achieve!

2023-10-17 09:17:00
Reaward Intel @reawardintel

@dr_cintas This was one of the first projects I ever worked on to illustrate the concept of information theory! I did it the old-fashioned way, but it is still such a good project; I recommend it to anyone learning to code!

2023-10-18 01:41:15
Intelligent Web Design @IntelliWebD

@dr_cintas That's incredible! ChatGPT with Vision has such powerful capabilities, it's astounding how quickly it can create relatively complex games. Maybe you should ask him to create a simple version of Minecraft next in python?

2023-10-18 00:59:31
Haider. @slow_developer

@dr_cintas I tested tic tac toe game in ChatGPT vision. Amazing 👇🏻 twitter.com/slow_developer…

2023-10-17 04:22:03
Haider. @slow_developer

With GPT-4 vision, you can do anything. It just coded this game based on the picture. 🤯 Here is the process I followed: pic.twitter.com/2FcP96LErA

2023-10-16 19:51:22

ChatGPT Visionとは
利用するためにはどうすればよいのか

リンク PCMAG What Is ChatGPT Vision? 7 Ways People Are Using This Wild New Feature With GPT-4V, the chatbot can now read and respond to questions about images, opening up a range of new capabilities. Here's how AI enthusiasts are using it so far. 25

電卓も作れる

Alvaro Cintas @dr_cintas

I finally got access to ChatGPT with Vision! The first thing I wanted to test was its coding capability with just a picture, and the results are mind-blowing. After sending only a screenshot of my calculator app, it essentially coded a replica of it. pic.twitter.com/UYNKawdaGE

2023-10-15 03:34:05
Alvaro Cintas @dr_cintas

This is the prompt I used: “You are a software developer. You have the attached image and you need to code an app with the same characteristics, color, shapes, etc. Please do so.” It provided me with one calculator that was not 100% the same, so it only took me one more prompt specifying that I wanted the same appearance as in the screenshot to get it complete correct. Also I find it useful to write: “Please think step by step”

2023-10-15 03:38:00
Camilo Villa @cahevigo

@dr_cintas It’s impressive how this new AI tools are transforming into some of our most reliable colleagues

2023-10-16 20:46:44
Nick Quick @heynickquick

@dr_cintas Wow! I love the addition of "think step-by-step". I'm going to stay adding that to all complex prompts 💪

2023-10-16 22:15:53
まとめ 生成AIのみでゲームを作ることに成功!製作時間もわずか数時間 さらには画像だけでコーディングすることも可能に DALLE 3でキャラ絵や背景画、GPT-4でコーディングしたとのことです。 後日プレイできるようになるらしいので、気になる方はご本人のアカをフォローしておくとよいでしょう。 10207 pv 12

ChatGPT Vision使用例

OpenAI @OpenAI

ChatGPT can now see, hear, and speak. Rolling out over next two weeks, Plus users will be able to have voice conversations with ChatGPT (iOS & Android) and to include images in conversations (all platforms). openai.com/blog/chatgpt-c… pic.twitter.com/paG0hMshXb

2023-09-25 21:12:55
Haider. @slow_developer

With GPT-4 vision, you can do anything. It just coded this game based on the picture. 🤯 Here is the process I followed: pic.twitter.com/2FcP96LErA

2023-10-16 19:51:22