3D Character Creation with Claude Code! Exploring Automation from Blender to UE5

3D Character Creation with Claude Code! Exploring Automation from Blender to UE5

3D Character Creation with Claude Code!
Exploring Automation from Blender to UE5

The Next-Generation 3DCG Workflow Powered by AI Agents

🎮 Ete Wants to Create 3D Characters
Ete (Muhai Eiten)

Ran! Listen up! I want to create 3D characters and make them move! Wouldn't it be amazing to animate my own original characters like in a video game!?

Ran (Yoneno Ran)

3D characters... That's quite an ambitious project. Where did you hear about this?

Ete

Well, I heard you can use this AI tool called "Claude Code" to create 3D models in something called Blender! And it does it automatically!

Ran

Claude Code... Yes, it has been getting a lot of attention lately. Though "automatically creating 3D models" might be a bit of a misconception. Shall I explain step by step?

Ete

I don't understand complicated stuff, so explain it in a way even I can understand!

Ran

*sigh* ...Understood. Let me start by explaining what "Claude Code" actually is.

🤖 What Exactly is "Claude Code"?
Ran

Claude Code is an "agentic coding tool" provided by Anthropic. Simply put, it's an AI that runs in your computer's terminal (the black command line window) and writes programs or manipulates files on your behalf.

Ete

Huh? Agentic...? Terminal...? I don't get it already!

Ran

Let me put it more simply. Regular ChatGPT or Claude chat interfaces just answer questions with text, right? Claude Code is different - it can actually perform tasks on your computer.

*"Agentic" refers to AI that autonomously makes decisions and takes actions. Rather than just waiting for instructions, it plans and executes tasks to achieve goals.

Ete

So... if I say "Do this!", it'll actually mess with my computer and do the work!?

Ran

Exactly! You catch on quick. Specifically, Claude Code has three major features:

🔧 Three Key Features of Claude Code

1. Local File Access
It can read files on your computer and create new ones.

2. Shell Command Execution
It can run commands in the terminal and decide what to do next based on the results.

3. Self-Repair Capability
If an error occurs, it can read the error message and rewrite the corrected code.

Ete

What!? Even if there's an error, it fixes it by itself!? That's incredible!

Ran

Yes, that's the strength of being "agentic." For example, if a Blender Python script fails with an "AttributeError," Claude Code reads that error message, recognizes "Oh, this API is outdated," and rewrites it with the new syntax before re-executing.

Ete

I see... So basically, regular AI chats "just talk," but Claude Code "actually gets things done"!

🎨 What Happens When You Combine Blender with Claude Code?
Ete

Now, now! Tell me about the Blender integration! That's what I really want to know!

Ran

Right, here's the main topic. First, a quick explanation about Blender: it's an open-source 3DCG software that can be controlled via programs using its Python API (bpy).

*Python API (bpy) is a set of functions for controlling Blender programmatically. This allows you to manipulate 3D models through code instead of manual operations.

Ete

I see... So Claude Code acts like an "interpreter"! It translates my "I want this!" into language that Blender understands (programs)!

✨ What Claude Code Excels at in Blender

🦴 Rig (Skeleton) Inspection and Correction
Bone naming convention checks, hierarchy structure fixes, adding missing bones

📦 Export Settings Optimization
Adjusting coordinate systems and scales for target engines like UE5 or Unity

🖼️ Material Baking
Converting procedural materials to texture images

🔍 Data Integrity Checks
UV map overlap detection, vertex group verification, etc.

⚠️ Blender Version Issues and Claude Code's True Value
Ran

Here's something important that shows Claude Code's true value. Blender version 4.0 introduced major API changes.

Ete

API changes...? Does that cause problems?

Ran

Yes, it's a significant issue. Before Blender 3.6, bones were managed using "Bone Layers," but from 4.0 onwards, this changed to a completely new system called "Bone Collections." This means old scripts simply won't work anymore.

❌ Old API (Blender 3.6 and earlier) - No longer works

bone.layers[0] = True obj.pose.bone_groups.new(name="GroupA")

✅ New API (Blender 4.0+) - Required

coll = armature.collections.get("GroupA") if not coll: coll = armature.collections.new("GroupA") coll.assign(bone)
Ete

Amazing! It realizes "Oh, this was outdated" after failing and fixes it by itself!?

🖼️ Can You Create 3D Models from Images?
Ete

Hey, I have the most important question! If I show Claude Code an illustration of my character, will it turn it into a 3D model?

Ran

Hmm... Let me be honest. That's difficult to do directly. However, there are some approaches to consider.

🎯 Methods for Creating 3D Models from Images

❌ What Claude Code Alone Cannot Do

Automatically generating high-quality 3D meshes from a single illustration. This requires specialized AI for image recognition → 3D shape estimation → mesh generation, which is outside Claude Code's scope.

⭕ What Claude Code Can Help With

• Creating scripts that interface with external "image-to-3D" tools

• Importing and refining generated 3D models in Blender

• Auto-rigging and bone structure optimization

• Preparing exports for UE5

Ete

I see! So Claude Code isn't a "jack of all trades" but an "excellent assistant"! It excels in its specialty areas!

🎮 How to Make Your Model Move in UE5?
Ete

Alright, here's the main event! I want to take my 3D character made in Blender and make it move in UE5! Smooth movements like in a video game!

Ran

It's not that simple... Actually, Blender and UE5 have different "world orientations."

😱 What Happens When You Get Coordinate Systems Wrong

• Your character lies face-down on the floor

• It faces backwards (showing its back to you)

• The size becomes 100x (or 1/100th) what it should be

Ran

It's okay! You don't need to understand this code, Ete-senpai. Just tell Claude Code "Export this Blender model for UE5," and it will automatically write and execute the appropriate code with proper settings.

🦴 UE5 Skeleton Compatibility Issues
Ran

There's another important topic. UE5 has a standard character skeleton called "Manny." If you match this, you can fully utilize UE5's features.

Ete

Oh! So if I use the same bone structure as Manny, I can use dance animations that other people made!?

🧠 Claude Code's Reasoning Examples

"Mixamo's LeftForeArm corresponds to UE5's lowerarm_l based on position"

"This rig lacks a root bone. UE5's root motion requires a root, so I need to create a parent bone at (0,0,0) and make Hips its child"

"UE5 Manny-specific ik_foot_root and ik_hand_root are missing, so I'll auto-generate these and position them to match the hand and foot bones"

✨ Summary: Claude Code is Amazing!
Ete

Wow, Claude Code really is incredible! To sum it up...

📝 What We Learned Today

🤖 What is Claude Code
An AI tool that runs in the terminal and actually operates your computer. Its "self-repair capability" to fix errors automatically is a major strength!

🎨 Blender Integration
It can automatically generate and execute Python scripts to automate rig inspection, bone corrections, export settings, and more. It even handles Blender 4.0's API changes!

🖼️ 3D Models from Images
Direct generation is difficult, but combining external 3D generation tools with Claude Code for subsequent refinement, rigging, and optimization is a realistic workflow!

🎮 UE5 Migration
Coordinate system conversion, skeleton compatibility, import settings - all these tedious tasks can potentially be fully automated!

⚠️ Caution
Properly configuring permissions for safe usage is essential!

Ete

Alright! Next time, I'm going to try actually using Claude Code to create a 3D character! You're helping me, Ran!

Ran

*sigh* ...Understood. But let's start with the basics first, Ete-senpai.

Ete

That's my Ran! I'm counting on you!

Ran

I-It's nothing... I just did what anyone would do...

Ete

That's all for today! Did you get a sense of the possibilities of 3DCG creation with Claude Code? We might bring you a hands-on practical guide next time! See you!

Ran

Thank you for reading this far. The combination of Claude Code, Blender, and UE5 will continue to evolve. See you next time!