Sitemaps
Discussions
DiscussionsQuestionsExperts

Topics

View All Posts

Get Feedback

Help! Would you use a service that checked ChatGPT's advice with live experts?

I need some help with idea validation for all of you ChatGPT users. Lend me your ears and a penny for your thoughts (with my enduring gratitude).


My working problem:


ChatGPT is generally excellent for advice, but how do you know it is giving you the best advice?


My working solution:


Build a platform that lets people ask ChatGPT for advice but then send that conversation to be reviewed by an expert in the field. The reviewer can add to the conversation and critique, but then ChatGPT has a chance to respond to the reviewer's comments and sends it all to you. The reviewer does not see ChatGPT's response to keep everybody honest.


You get the best of both worlds. The efficiency of an AI model, but then the refining touch of a live expert with less friction (not to mention cost).


For example:


I am a super busy startup advisor, and my calendar is packed. You would ask ChatGPT your initial questions and it would answer. Then I would get a copy of that conversation and add my thoughts, whether I agree or disagree, and anything I would add or change. Then ChatGPT would respond, without my knowledge or further input, and you would get the whole conversation. You could then continue the conversation with ChatGPT based on our collective input. Later, you could even invite other collaborators and ChatGPT would synthesize, moderate, and process the whole conversation for something useful.


What do you think? What am I missing? How would you want it?


Ed Kangposted a year ago

Upgrade to join the discussion.

Already a member? Login

Upgrade to Unlock

Nathan Kaufman

I like this idea. Is it niche specific? I'm just starting to use ChatGPT and have used it to write PowerShell and code for things I want to accomplish. Asking an expert to help me figure out more from there would be great. I would want options to choose from, a profile of proficient professionals and then reach out to them.


Scripting / Coding would be one I would like to use. One thing I'm trying to figure out using ChatGPT is how to upload a .csv file from a business name and location, then grab its web domain. If I can get the domain, I can upload that into Apollo.io and see if there's contacts for that company. Dell has an incentive program to sell business to these companies but are missing the domain name URL.



Replya year ago

Marc Ragsdale

I'd do it out of curiosity more than anything else so long as it is very simple and doesn't require me to exert too much effort. If it turned out to be useful I'd return.

Amber KB Wilson

Hi there, Ed! I think you've got some good feedback here -- but I'll throw my two cents in as a beginner-intermediate ChatGPT user and also total enthusiast. Your idea....sounds REALLY interesting. And I think there's something here.


I'm constantly trying to up-level my prompting skills...so if you haven't already done so, I'd consider the experience level of users coming in and providing different levels of prompts. How will that effect the level of support a human expert will provide? Are they, themselves, expert "prompt engineers"? Or is there going to be a lot of back and forth trying to get the "right" information out of ChatGPT from BOTH of these humans?


Additionally, something I've found myself personally wanting (or at least trying to get out of ChatGPT) is a whole lot of, "Great! ...now what do I do with this information?" I've even tried asking, "What type of role should I ask for more information about this?" -- Or "Who could I hire to manage/execute this task you just suggested." A specific example for this is me is trying to work out our go to market strategy. It gave me a lot of good information and tasks to execute on, but then I realized I needed an actual human to do a lot of it. ChatGPT gave me great surface level exposure to things that would have taken me WAY longer to discover through a google search...but sometimes you just need to get a human working on the stuff it's talking about. I'm so buddy-buddy with ChatGPT now, that I mildly wish it WOULD suggest humans I could go to. But that's just me, haha.


I hope that made sense, feel free to slack me if you want to pick my brain more about it or want further clarification on anything I said.

Margaret Mannion

Hey Ed! I think this idea has legs but can also see some pitfalls. First one being, "will our users trust an expert more than they trust ChatGPT?" ChatGPT can be wrong but is backed by the collective wisdom of the internet so is pretty accurate.  Experts can also be fallible. Will you be able to attract the caliber of experts needed where people will truly trust them? How expensive will this be?


Another item to consider is  defensibility and innovation. As Open AI continues to evolve Chat GPT it's likely to become more and more accurate. Will there still be a need for expert support once this happens?


i could see this as a lead gen opportunity for experts. E.g if I need advice on a legal matter. I can use Chat GPT to get an outline of considerations and then referred to a lawyer who can talk me through the matter. Presumably the lawyer would pay you a referral fee.


1 Replies

Scott Norberg

The first thing I thought of when I saw this was an experience I had on LinkedIn. LinkedIn asked an AI to create about a particular type of security flaw then asked me to review it. (I don't know whether the post was written by ChatGPT, but since Microsoft owns LinkedIn and is an investor in OpenAI I think it's likely.) The blog post highlighted all of the useless noise people talk about when talking about security without getting into the specific issues of this particular flaw, which meant that I basically suggested fixes on the entire article.


So, I experienced something close to your proposed business model and I walked away less than impressed.


I think another challenge you're going to run into is getting experts to take the time to opine on ChatGPT outputs. You might have a fighting shot at removing that as an issue if you keep the scope of the original bot extremely narrow and grow from there.


The last challenge that I see is that I see is that a lot of folks think that ChatGPT is trustworthy on its own. Convincing people otherwise will be difficult.


Skepticism aside, if I were to try this business idea, I might do the reverse - sell the expert's advice, then have ChatGPT generate the boilerplate to save on costs. "Ask an expert/consultant for the fraction of the cost" might be a selling point to some companies who want a consultant's advice without the typical consultant's cost. It also gives you a bit of a differentiator if you can find consultants with a reputation high enough to separate yourself from the inevitable imitators.

1 Replies