Wednesday, June 8, 2011

SkyDrive try

My experience with SkyDrive has been a drastic failure so far. I've been trying to put my toe in the water by moving a folder of IT reference articles, presentations, and policy docs that I've carried around for 10+ years up to the SkyDrive. Figured my access was usually 10% editing (or less) and 90% reading, so this would let me get used to having the files in the cloud without having synch be a major concern.

Of course, I'm too impatient to upload the files/folders through the web interface, so i immediately set out to get Windows file system access, and use a sync tool to at least push the files one-way.

It appears to be possible to Map a network drive (How to Map SkyDrive as a Network Drive), using a CodePlex project - SkyDrive Simple Viewer to nav your SkyDrive. Started by doing a Window Copy-Paste, of course it's dreadfully slow and errors out on Visio diagram, among other file types i didn't take note of.

So, on to using SyncToy to copy the files up - at least it will run unobtrusively, and I can review which files were exceptions. SyncToy 2.0 fails immediately upon running the sync, so i look into it... SyncToy 2.1 is out - i had never needed to upgrade... it doesn't fail right away... but every. file. failed. "Exception during run: The FileSyncProvider received an unexpected error while applying a synchronized change. Creating new file {File Name}", and the sync task stops.

Will park this for now... further updates as I retrench and rethink how to attack this

Wednesday, March 30, 2011

Source Code Control - SQL Server/Business Intelligence Stack



    One of the items weighing on my mind is that I have not introduced a true source code control process for my team working primarily with the SQL Server business intelligence stack. A source code control process is not need on this team to 'control' or 'audit' the work among the team, but provide some basic tools for working together:





  1. The ability to work on source code, being confident you are working against the latest and greatest version your team has been able to put together.


  2. The ability to develop source code, and review your work for quality before contributing to the team, and be confident your work will not accidentally override another, or be overridden


  3. The ability to review changes history on code regardless of author, to investigate behaviour at past point and/or rule out "code changes" as the cause of a problem


  4. Current methods



  5. All dev staff RDP into the development server to work on core, server-side projects - especially SSAS and core SSRS


  6. A few of us tend to work locally on SSIS, SSRS, and SQLscripts, then use sync toy to move files up to a file server… use synctoy on the development server to sync files from the share drive down


  7. All staff work on SQL scripts from their own machines, and kind of hope we don't collide with each other




  8. Based on inquiring in and around my organization, and also bringing it up during 'group therapy' session at the Sacramento SQL Server User Group, options included Visual Source Safe, CVS (which based on rudimentary research, actually SVN would be preferred), and Git, which I've been reading about mostly from the open source world. Upon researching Visual Source Safe, learned this old file-based standby is being deprecated by Microsoft in favor of their true server product - Team Foundation Server)



    Alternatives



    Visual Source Safe





























    AdvantagesDisadvantages


    Integration with Visual Studio (for SSIS, SSRS and SSAS)



    License cost/ Procurement process required



    Uses existing file server



    Requires a checkout-edit-checkin workflow





    Is actually in de-support by Microsoft in favor of Team Foundation Server (TFS)





    SVN (client-side tool - TortoiseSVN)

































    Advantages



    Disadvantages



    Free/Open Source



    Lack of integration with Visual Studio (for SSIS, SSRS and SSAS) - 3rd party tool available for $49/seat



    Supports an Edit-Merge-Commit workflow





    Uses existing file server





    http://www.codeproject.com/KB/dotnet/SourceControl_VSNET.aspx





    Git (client-side tool - mySysGit)







































    Advantages



    Disadvantages



    Free/Open Source



    Lack of integration with Visual Studio (for SSIS, SSRS and SSAS)



    Supports an Edit-Merge-Commit workflow





    Uses existing file server?



    Appears to be more geared to storing a project on the open internet (i.e. http:)





    Focuses a lot more on branching and merging - good for bazaar-type development, but not as much value for a small focused (relatively) team





    Team Foundation Server

































    Advantages



    Disadvantages



    Integration with Visual Studio



    Not currently available in our organization. Another shop is evaluating it - need to assess and leverage their efforts, as well as determine licensing



    Other dev lifecycle tools





    Integration with SharePoint



Friday, February 18, 2011

Project War Room

Finalized a project for CDCR - a Court Compliance Reporting Portal - wrapped up the project war room. See, not only do I see projects as having a defined start and end, but a defined location as well. This was the war room for the duration of the project, and of course, it was left cleaner then when it started:



















During UseAfter Use

Tuesday, January 4, 2011

Recommended SSIS blog

Been following a blog series on SSIS, with recent topic:
31 Days of SSIS - Folder Structures

My response:
Can tell you use an organized layout, and some of the concepts under workfiles I hadn’t
considered before.

What do I do differently?
Well the concept of WorkFiles is outside of the ‘SSIS’ hierachy, in fact by the time it gets to production on an entirely different drive. One reason is that the WorkFiles lives on whether another developer was to follow me and structure packages differently… or for that matter a different ETL tool was used, or even reverted to importing ‘manually’. Second reason is the source control and permissions alluded to. Non-developers in my environment need access to the WorkFiles, on a regular basis to drop off files, and in rarer situations, to see what files have been imported. Confuses me to much to have this mixed in with folders that need source code control.

Under my equivalant to WorkFiles/Project, there is a ‘Samples’ folder which contains samples (i.e. templates) of what the files are ‘supposed’ to look like. Especially with Excel files, i’ve found a groove where if the package uses a file under ‘WorkFiles/Project/Samples’ at design, then have it loop through ‘WorkFiles/Project’ at execute time. This can be challenging though if the ‘Samples’ get out of sync with the package.

Tuesday, September 21, 2010

Enesys RS Data Extension

This product looks like a leap in using SSRS with SharePoint lists as a data source

Enesys RS Data Extension

As pointed out in Creating Reports From SharePoint Lists Using SQL Server Reporting Services (SSRS) , it is pretty much impossible to directly query from more than one list in SSRS using the web services as a data source. Even with a single list, doing so requires some fine-tuning of the XML request, looking up a list and view guid, and the whatnot. At this point, nothing I would be prepared to hand off to the typical report analyst role.

Looks like the Enesys product makes it pretty clear to pull from a SharePoint list by name, and some features to pull from multiple lists in a query of some sort...

Also, looking at the Enesys IS data extension asserts to be able to pull from SharePoint lists directly, I've only, again, used the web services in SharePoint to pull from a single list as XML - there is a lot of hand-coding in the process.

Will be grabbing an evaluation copy soon and see how it works!

UML stencils for Visio

Ran across UML stencils for Visio, which appear to be an open source download.

UML, is a codified way for analysts to present and document their work, and even Microsoft Visio Professional's UML stencils don’t truly conform to latest version of UML, but these stencils are closer…

Visio Templates for UML 2.0

Saturday, September 4, 2010

Mashup Development

Reading the ProgrammableWeb and other sites, recently, was feeling behind on the technology of creating mashups.

Decided to at least start a very basic one, to remind myself of the steps, and start hooking into a more modern API. Started with... Programmable Web's 'How to make your own mashup' article, and browsed through the APIs. I had did maps years ago with Virtual Earth and Google Maps, and while my skills are completely up to the latest mapping, creating yet another mapping mashup didn't enthrall me, and I couldn't come up with any compelling ideas.

So, settled on using LinkedIn's API (which has a bad link as of this writing, but found the correct link to LinkedIn's API site) and started up using the Company Insider Widget.

Had to remind myself some of the basic layout of JavaScript, The Linked In api thus far has been simple to use and their documentation clear.

The View Source bookmarklet and/or IE 8 Developer Tools came in handy, for those unfamiliar, the 'View Source' in the web browser proper shows the source of the page upon load from a web server. When dynamic script modifies the page, another tool is needed to show the source of the page as 'currently' rendered.

So my work in progress project is the Real World IS Company Viewer allowing some ways to display various company information. Definitely just a starting point, kind of stumbled upon a feature in the API that adds information about a company each time a certain API is called, rather than replacing the existing information. With that, I'm envisioning expanding the interface to build up a list of companies to 'watch'