{"id":5951,"date":"2018-11-12T11:12:38","date_gmt":"2018-11-12T16:12:38","guid":{"rendered":"https:\/\/www.rushworth.us\/lisa\/?p=5951"},"modified":"2020-02-06T11:24:23","modified_gmt":"2020-02-06T16:24:23","slug":"oud-11g-failure","status":"publish","type":"post","link":"https:\/\/www.rushworth.us\/lisa\/?p=5951","title":{"rendered":"OUD 11g Failure"},"content":{"rendered":"<p>Ran out of disk space on the OUD partition (don&#8217;t let people turn on debug logging!!). Easily fixed &#8212; stop service, remove big log file, start again. Unfortunately that &#8220;start again&#8221; wasn&#8217;t as easy as it could have been. Server startup fails. It says the cryptomanager failed to publish the instance-key-pair in ADS &#8230;. which, Oracle says means <a href=\"https:\/\/support.oracle.com\/knowledge\/Middleware\/2257051_1.html\" target=\"_blank\" rel=\"noopener noreferrer\">you get to recreate the single instance<\/a>. Honestly, this isn&#8217;t a <em>horrible<\/em> process since I&#8217;ve got a backup of the directory. But I&#8217;d rather <em>not<\/em> spend the next hour messing around with the server.<\/p>\n<p>The underlying problem is that the admin partition didn&#8217;t dump out to its storage file (full disk), so admin-backend.ldif is a 0-byte file. Now, had the directory been running when I noticed this &#8230; I could have dumped the cn=admin data partition to another volume and copied the file in once I cleared up disk space. But I have a file-level backup &#8230; and it was easy enough to pull the file from last night back. Voila, one server online in a couple of minutes. And a good reminder for the future that a shutdown with a full disk &#8230; no good. I probably want to find <em>something<\/em>\u00a0to free up a couple meg of space prior to shutting down the server. Extra-cautious option would be the MS Exchange approach of creating a few 5-meg files\u00a0to ensure there&#8217;s space that can be freed up.<\/p>\n<p>&nbsp;<\/p>\n<p><em>Added 06 Feb 2020<\/em>: One of my colleagues encountered this problem again today, and it turns out you can copy the admin-backend.ldif from <em>another<\/em> server too. It may not be 100% &#8212; he cannot log into the server through the admin console. But he&#8217;s got a directory being served &amp; no users complaining about an outage. It can get sorted <em>properly<\/em> later.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Ran out of disk space on the OUD partition (don&#8217;t let people turn on debug logging!!). Easily fixed &#8212; stop service, remove big log file, start again. Unfortunately that &#8220;start again&#8221; wasn&#8217;t as easy as it could have been. Server startup fails. It says the cryptomanager failed to publish the instance-key-pair in ADS &#8230;. which, &hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[30],"tags":[595,591,903],"class_list":["post-5951","post","type-post","status-publish","format-standard","hentry","category-system-administration","tag-oracle","tag-oud","tag-oud-11g"],"_links":{"self":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/5951","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5951"}],"version-history":[{"count":1,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/5951\/revisions"}],"predecessor-version":[{"id":5952,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=\/wp\/v2\/posts\/5951\/revisions\/5952"}],"wp:attachment":[{"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5951"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5951"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.rushworth.us\/lisa\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5951"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}