{"id":12605,"date":"2026-06-23T21:03:36","date_gmt":"2026-06-24T02:03:36","guid":{"rendered":"https:\/\/www.rushworth.us\/lisa\/?p=12605"},"modified":"2026-10-23T09:14:48","modified_gmt":"2026-10-23T14:14:48","slug":"token-usage-efficiency","status":"publish","type":"post","link":"https:\/\/www.rushworth.us\/lisa\/?p=12605","title":{"rendered":"Token Usage Efficiency"},"content":{"rendered":"<p>Whenever I hear people start to talk about efficient token usage &#8212; the same people who, a year ago, were USE IT, USE IT, USE IT!!!! Don&#8217;t think about where AI is appropriate and where it isn&#8217;t! who are now decreeing that all AI usage should be well thought out to see if it even needs AI, done in the most efficient manner possible, etc &#8212; I think about early mobile phones. Specifically the big bag that went in a car. I knew so many people who got one and would call from the driveway or garage to say &#8220;hey, honey, guess where I&#8217;m calling from!&#8221; Which was less funny the nineteenth time the answer was &#8220;just pulled into the driveway&#8221; or &#8220;the garage!!!&#8221;.<\/p>\n<p>And then they got their first bill. Now, folks <em>buying<\/em> the bag phone generally weren&#8217;t ruined by a one-off thousand dollar airtime bill. But they <em>were<\/em> shocked by it (and stopped calling from the garage).<\/p>\n<p>The past year has been the &#8220;guess where I&#8217;m calling from!&#8221; Stage of AI. And I think someone just saw the bill!<\/p>\n<p>&nbsp;<\/p>\n<p>An example we used to use in programming class &#8212; the question is &#8220;2+3&#8221;. Writing 5 is the &#8220;scored 100%&#8221; answer. You were never\u00a0<em>asked<\/em> to write a program. Now, if someone writes a program (which is an inefficient way to solve the problem) and takes user input &#8230; they&#8217;ll get a good score too. Hard code the 2 and 3 at the top as variables used subsequently (i.e. identify the probability that the next time this code is used, you may want to add 7 and 284), that&#8217;s OK too.<\/p>\n<p>The guy who writes\u00a0<em>this<\/em>? 75% &#8211; mediocre work.<\/p>\n<pre>#include &lt;iostream&gt;\r\nint main() {\r\n     std::cout &lt;&lt; 2 + 3 &lt;&lt; '\\n';\r\n     return 0;\r\n}<\/pre>\n<p>Well, maybe lower for failure to document the code. I&#8217;ve been asking an analogous question about AI since it first hit mainstream. The Ducks, Google, etc all have AI enhanced answers to web searches. Sometimes it&#8217;s enlightening, enriching, and useful &#8230; but it&#8217;s often the high resource approach to answering a straight forward question. It would make a lot more sense to have the &#8220;enhance your answer with AI!!!&#8221; button at the top and only incur the usage when the top couple of web results don&#8217;t already answer the question.<\/p>\n<p>Does it make sense to have an AI agent generate a weekly report? No! Ask for a script that will generate the report (a one-time expense) and schedule execution of that script. The results don&#8217;t change (well, if the source data changes the script may need to be updated to continue working). Does it make sense to have an AI count the number of times &#8220;ThisString&#8221; occurs in your spreadsheet data? No! Use countif() and the spreadsheet can do this for you.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Whenever I hear people start to talk about efficient token usage &#8212; the same people who, a year ago, were USE IT, USE IT, USE IT!!!! Don&#8217;t think about where AI is appropriate and where it isn&#8217;t! who are now decreeing that all AI usage should be well thought out to see if it even &hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2141],"tags":[764,2237,2236],"class_list":["post-12605","post","type-post","status-publish","format-standard","hentry","category-ai","tag-ai","tag-cost-containment","tag-cost-reduction"],"_links":{"self":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/12605","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=12605"}],"version-history":[{"count":1,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/12605\/revisions"}],"predecessor-version":[{"id":12606,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/12605\/revisions\/12606"}],"wp:attachment":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=12605"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=12605"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=12605"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}