02 · 24 posts

Product & Design

产品与设计

Eval design, PRDs, design tools and product judgment. Is what you built a product, or only the shape of one?

Filter and search this topic in all posts →
S2 Day 033
When your users aren't only human当产品的用户不只有人,还有 Agent,软件该怎么设计?

Using Dot made me realize Roleward doesn’t need to become yet another Agent—what it should be is Agent-ready, so outside Agents can call its core capabilities safely and clearly.

S2 Day 031
Projects or Spaces: do you need both?ChatGPT - 有了Project,还需要 Space 吗?

The difference between Projects and Spaces isn’t whether you can save materials or collaborate with others—it’s the entry point for work: a Project centers on Chat, a Space centers on outputs like Pages.

S2 Day 023
Some thoughts on eval design分享一下我对 Eval Design 的想法

This day was a video on RedNote.

S2 Day 011
Putting gains and costs together: how to do the math on an AI project把收益和成本放在一起以后,AI 项目应该怎样算账?

Having put gains and costs together, I didn’t find an “average enterprise AI ROI” worth believing: the economics depend heavily on the task, baseline, users and workflow, and the better question is under what conditions a specific workflow is worth scaling up.

S2 Day 010
Where should the cost of AI stop?AI 的成本,应该算到哪里?

API prices are easy to look up, but they aren’t the whole bill: getting AI running, making its results trustworthy, and keeping it alive long term each carry costs you can’t see in the token price, and which is biggest depends on the specific workflow.

S2 Day 009
After the productivity gain, what do companies actually get?AI 提效之后,企业真正得到了什么?

AI’s productivity gains on specific tasks like customer service and writing code already have decent real-world evidence, but between “one person working faster” and “the company actually getting economic value” there are still several steps.

Day 077
When a measure becomes a target: Goodhart's Law当指标变成目标,它可能就失效了:我最近重新理解 Goodhart’s Law

A metric is meant to help me see the goal, but once I treat it as the goal — “this post has to get so many likes,” “apply to 5 jobs a week” — my behavior follows the number, and may end up further from what I actually want.

Day 074
Design can't wait until features are doneAI 独立开发:设计不能等功能做完再补

My product was ugly because design came in too late. While Codex was writing code it was already deciding the UI/UX for me; each page made sense on its own, but together they didn’t look like one product.

Day 062
AI writes PRDs fast — how does a PM review them?AI 生成 PRD 很快,PM 怎么审得过来?

Once AI writes the PRD, generation is no longer the bottleneck. The new bottleneck is whether I can actually spot the changes, assumptions and problems in a document that’s fast, long and reads smoothly.

Day 061
Building with AI: which calls can't be delegated?和 AI 一起做产品,哪些判断不能交给它?

When building products with AI, what really needs distinguishing isn’t who wrote which document, but whether a piece of work is organizing and exploring, or deciding on the product’s behalf. AI widens the options and fills in detail; the PM converges, makes trade-offs and confirms.

Day 060
Claude Design wrote DESIGN.md — why is the design still off?Claude Design 写了 DESIGN.md,为什么设计还是不对?

The DESIGN.md Claude Design wrote for me had colors, fonts, spacing and components, and was still off: it explained what the interface should look like, not why the product should be designed that way.

Day 055
Harness engineering and the AI PMHarness Engineering 这么偏工程,和 AI PM 有什么关系?

Implementing harness engineering really is engineering-heavy, but once an agent can read data, call tools and act for users, the decisions about information, permissions, boundaries, acceptance and human intervention were always part of product design.

Day 043
Why eval design is becoming core to AI PM为什么 Eval Design 会成为 AI PM 的核心能力?

The hard part of AI products isn’t only bringing AI in; it’s managing its uncertainty. Eval design answers exactly “what counts as right, which errors must be stopped, and how the next version proves it’s better,” so it’s a core skill for how an AI PM manages quality.

Day 042
Eval design in practice: Asterline一个 Eval Design 的真实实践案例:Asterline

I took Asterline, a demo I built, through the whole Eval Design process. The company and the data are fake, but the iteration loop — from Golden Set and Rubric to Failure Types — is real.

Day 041
What is eval design? Defining what "right" meansEval Design 到底是什么?不是给 AI 打分,而是定义什么叫做对

I used to think eval design meant running a few cases and giving AI a score. Now I think what it really has to answer is: for a specific task, what counts as right, what counts as wrong, and what to fix when it’s wrong.

Day 040
After vibe coding: a product, or the shape of one?Vibe coding 之后,我开始重新想:做出来的是产品,还是产品的形状?

Vibe coding has made “building it” cheap, but the difficulty of a product hasn’t gone away; it has moved later. A demo proves something is possible; a product has to prove it keeps creating value when inputs get messy and users don’t behave as expected.

Day 026
Reading The Mom Test读 The Mom Test:别再问用户“你会不会用?”

AI makes “building it” easier and easier, and also lets us build things nobody needs faster. The Mom Test reminds me not to ask users “would you use this,” but when they last actually ran into the problem.

Day 025
Build to Last, eight months on: code gets cheaper, judgment gets pricier8个月后再看 Build to Last: 代码越来越便宜,判断越来越贵

Rereading fast.ai’s Build to Last eight months on, my conclusion is: the better AI gets at writing code, the less we can give up understanding our systems. Code keeps getting cheaper; judgment keeps getting more expensive.

Day 012
Designers are becoming half-buildersAI 时代,设计师正在变成半个 builder

After reading AI in Design 2026, I think the question isn’t whether AI will replace designers, but that design is shifting from delivering design files to organizing a process that runs from idea to implementation.

Day 010
Can you tell which one AI made?你能看出来哪张是 AI 做的吗

I used GPT image 2.0 to imitate the illustration style of Airbnb’s city invitation cards. The images really are impressive, but the surprise feels predictable, as if something like a “soul” were missing.

Day 009
One way to make AI design look good让 AI 设计变好看的一个方法

My way of getting good-looking design out of AI is to break the job into steps: general agents set the framework early, design agents do the UI/UX in the middle, coding agents build it at the end, and each step gets the tool best suited to it.

Day 008
Figma ships a native design agentFigma 发布 Native Design Agent

Figma released its own design agent, and I’m curious whether its target users can move beyond designers to the wider builder group.

Day 004
My first landing page with Claude Design第一次用 Claude Design 做 Landing Page

Of the many design tools I’ve tried, Claude Design turned in one of the more satisfying results. It surprised me more than Google Stitch did, though maybe I just hadn’t found the right way to use Stitch.

Day 003
90 Product Hunt winners: five lessons for indie makers看了 90 个 PH 上榜产品:给独立开发者的 5 个参考

After going through 90 products from the Product Hunt leaderboards for March to May, I see the AI buzz shifting from “models and platforms” to “workflows and execution”: people don’t want a smarter AI, they want a product that finishes a piece of the task for them.